-- Logs begin at Mon 2022-07-11 13:20:49 UTC, end at Mon 2022-07-11 14:30:25 UTC. -- Jul 11 13:57:53.000552 dv-cinder-848429-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 13:57:53.009671 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 13:57:53 2022] *** Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: nodename: dv-cinder-848429-3-iscsi Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: machine: x86_64 Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: clock source: unix Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: pcre jit disabled Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: detected number of CPU cores: 4 Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: current working directory: / Jul 11 13:57:53.011735 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: detected binary path: /usr/bin/uwsgi-core Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: your processes number limit is 47680 Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: your memory page size is 4096 bytes Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: detected max file descriptor number: 2048 Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: lock engine: pthread robust mutexes Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: thunder lock: enabled Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 13:57:53.012430 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 13:57:53.056871 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: Python main interpreter initialized at 0x5588e07339c0 Jul 11 13:57:53.056871 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: python threads support enabled Jul 11 13:57:53.056871 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: your server socket listen backlog is limited to 100 connections Jul 11 13:57:53.056871 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: your mercy for graceful operations on workers is 90 seconds Jul 11 13:57:53.057370 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 13:57:53.057370 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: *** Operational MODE: preforking *** Jul 11 13:57:53.057590 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: *** uWSGI is running in multiple interpreter mode *** Jul 11 13:57:53.057590 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: spawned uWSGI master process (pid: 103406) Jul 11 13:57:53.057813 dv-cinder-848429-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 13:57:53.059014 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: spawned uWSGI worker 1 (pid: 103407, cores: 1) Jul 11 13:57:53.059014 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: spawned uWSGI worker 2 (pid: 103408, cores: 1) Jul 11 13:57:53.059014 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 13:57:53.725869 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 13:57:53.735962 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 13:57:54.860013 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:57:54.860013 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Jul 11 13:57:54.860612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:57:54.860612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: from cryptography.utils import int_from_bytes Jul 11 13:57:54.863208 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:57:54.863208 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 11 13:57:54.863683 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:57:54.863683 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: from cryptography.utils import int_from_bytes Jul 11 13:57:57.354477 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 13:57:57.355119 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 13:57:57.355227 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 13:57:57.355549 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 13:57:57.355778 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 13:57:57.356179 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.356508 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.356836 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.357225 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.357498 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.357811 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.358136 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.358505 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.358840 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.359105 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.359424 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.359753 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-3-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.360081 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.360392 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.360707 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.360877 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 13:57:57.361247 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.361336 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 13:57:57.361420 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.361642 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 13:57:57.361740 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.361948 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.362045 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 13:57:57.362244 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 13:57:57.362475 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.362661 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.363719 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.363869 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.363984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364115 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364233 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364361 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364483 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364617 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364768 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.364903 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365046 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365195 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365335 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365453 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365574 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365702 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365702 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.365943 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366067 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366194 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366353 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-3-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366516 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-3-iscsi {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366670 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.366917 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367045 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367168 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367295 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367434 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367563 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367693 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.367872 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.368001 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.368186 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.368323 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.368510 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.368716 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.368861 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.369026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.369162 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.369331 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.369464 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.369640 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.369777 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370004 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370136 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370344 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370489 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370657 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370797 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.370978 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.371113 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.371288 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.371420 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.371609 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.371732 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372010 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372153 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372395 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372537 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-3-iscsi {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372689 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372819 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.372953 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.373082 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.373265 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.373400 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.373592 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.373727 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.373921 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374063 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374194 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374357 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374501 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374665 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.374990 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.375119 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.375299 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.375436 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.375626 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.375763 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.375946 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.376081 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.376257 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.376399 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.376568 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.376710 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.376869 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377000 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377177 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377310 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377484 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377695 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377821 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.377947 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378076 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378199 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378388 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378536 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378661 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378789 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.378918 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.379040 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.379238 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.379444 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.379579 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.379702 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.379871 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380007 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380138 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380326 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380467 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380652 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380778 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.380971 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.381099 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.381277 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.381402 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.381585 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.381722 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.381892 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382020 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382197 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382369 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382532 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382660 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382837 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.382970 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.383145 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.383277 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.383479 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.383612 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.383745 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.383866 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384038 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384172 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384348 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384488 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384670 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384799 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.384979 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.385111 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.385287 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.385421 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.385594 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.385728 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.385897 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386024 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386204 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386392 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386520 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386654 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.386966 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.387140 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.387276 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.387448 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.387585 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.387756 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.387891 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.388065 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.388203 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.388373 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.388499 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.388679 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.388813 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389002 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389130 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389303 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389428 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389560 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389683 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389845 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.389972 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.390153 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.390286 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.390497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.390631 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.390803 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.390930 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.391108 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.391234 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.391411 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.391550 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.391711 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.391845 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392015 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392150 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392320 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392445 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392623 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392749 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.392928 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393054 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393232 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393366 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393536 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393663 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393839 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.393974 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.394143 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.394282 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.394470 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.394598 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.394781 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.394907 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395090 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395225 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395393 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395525 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395696 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395823 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.395999 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.396140 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.396302 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.396437 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.396603 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.396728 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.396909 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397059 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397315 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397455 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397586 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397715 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397850 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.397980 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.398113 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.398237 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.398426 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.398566 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.398732 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.398870 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.399553 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.399685 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.399875 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.400002 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.400176 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.400311 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.400482 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.400617 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.400801 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.400939 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.401107 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.401241 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.401413 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.401549 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.401714 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.401847 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.402016 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.402144 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.402330 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.402471 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.402641 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.402768 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.402943 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.403078 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.403245 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.403378 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.403544 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.403681 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.403862 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.403989 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.404183 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.404320 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.404491 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.404695 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.404821 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.404951 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.405074 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.405202 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.405390 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:57:57.405519 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.405724 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.405851 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.406058 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.406191 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.406425 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.406553 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.406743 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.406879 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.407060 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.407192 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.407393 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.407536 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.407712 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.407856 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408025 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408152 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408338 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408480 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408664 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408798 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.408974 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.409103 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.409283 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.409409 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.409593 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.409728 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.409910 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.410038 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.410227 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.410387 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.410588 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.410712 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.410906 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411034 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411222 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411348 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411539 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411665 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411851 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.411989 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.412166 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.412294 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.412481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.412615 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.412808 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.412948 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.413119 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.413253 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.413436 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.413560 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.413751 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.413886 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.414074 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.414202 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.414410 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.414541 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.415279 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.415420 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.415593 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.415719 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.415905 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416028 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416211 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416345 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416520 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416653 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416833 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.416966 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.417143 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.417270 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.417463 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.417586 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.417778 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.417903 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.418087 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.418211 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.418422 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.418556 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.418735 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.418860 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419047 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419171 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419362 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419488 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419676 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419800 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.419984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.420125 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.420295 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.420419 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.420607 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.420741 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.420918 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421050 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421232 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421360 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421543 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421678 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421849 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.421976 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.422154 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.422294 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.422490 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.422627 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.422800 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.422926 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.423104 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.423230 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.423424 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.423559 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.423743 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.423878 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424048 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424174 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424362 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424488 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424676 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424812 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.424989 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.425116 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.425303 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.425430 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.425615 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.425734 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.425922 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.426048 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.426235 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.426380 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.426574 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.426702 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.426881 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.427009 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.427208 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.427346 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.427515 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.427641 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.427819 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428026 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428157 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428285 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428416 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428539 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428712 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.428849 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.429026 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.429422 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.429602 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.429729 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.429910 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.430054 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.430244 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.430408 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.430589 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.430714 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.430894 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431034 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431218 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431343 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431533 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431660 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431839 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.431966 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.432147 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.432274 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.432455 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.432606 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.432829 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.432973 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.433109 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.433231 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.433409 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.433541 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.433712 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.433847 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434023 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434159 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434360 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434501 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434638 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434763 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.434942 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435070 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435250 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435390 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435552 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435686 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435852 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.435979 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.436156 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.436293 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.436457 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.436584 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.436761 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.436888 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437083 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437225 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437390 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437517 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437692 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437827 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.437995 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.438132 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.438311 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.438471 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.438661 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.438799 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.438966 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.439109 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.439307 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.439434 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.439641 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.439766 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.439954 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.440079 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.440275 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.440401 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.440585 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.440718 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.440901 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441027 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441209 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441334 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441521 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441648 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441830 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.441957 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.442143 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.442275 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.442485 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.442611 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.442798 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.442927 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.443116 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.443243 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.443428 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.443569 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.443775 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.443938 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.444062 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.444184 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.444362 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.444499 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.444700 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.444828 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.445016 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.445149 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.445344 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.445482 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.445673 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.445825 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446015 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446146 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446351 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446498 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446662 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446788 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.446977 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.447103 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.447287 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.447414 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.447596 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.447729 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.447905 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448033 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448213 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448346 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448526 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448649 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448836 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.448961 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.449149 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.449282 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.449456 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.449587 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.449763 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.449895 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.450073 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.450199 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.450405 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.450524 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.450709 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.450834 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451014 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451140 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451337 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451463 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451665 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451800 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.451977 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.452102 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.452289 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.452416 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.452610 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.452745 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.452916 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453043 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453222 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453348 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453533 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453673 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453840 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.453967 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.454146 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.454278 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.454478 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.454618 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.454784 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.454917 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.455091 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.455216 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.455399 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.455527 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.455703 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.455830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456018 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456138 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456327 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456461 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456629 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456763 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.456931 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457058 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457257 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457388 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457541 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457674 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457849 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.457974 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.458170 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.458351 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.458506 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.458631 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.458809 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.458949 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.459122 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.459250 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.459425 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.459557 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.459732 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.459871 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460037 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460156 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460342 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460470 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460646 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460782 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.460959 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.461091 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.461275 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.461909 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.462099 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.462239 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.462446 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.462573 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.462768 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463019 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463167 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463358 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463486 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463678 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463812 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.463988 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.464122 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.464308 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.464442 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.464620 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.464745 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.464931 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.465066 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.465243 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.465371 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.465555 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.465681 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.465866 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466002 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466175 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466362 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466503 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466635 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466812 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.466945 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.467124 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.467250 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.467433 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.467558 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.467736 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.467862 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.468043 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.468169 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.468359 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.468497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.468668 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.468920 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.469048 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.469255 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.469382 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.469569 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.469695 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.469887 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470014 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470196 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470348 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470534 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470661 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470845 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.470980 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.471173 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.471301 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.471488 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.471616 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.471803 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.471944 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.472111 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.472244 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.472420 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.472546 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.472726 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.472862 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473039 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473174 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473347 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473474 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473655 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473783 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.473961 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.474096 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.474273 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.474420 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.474614 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.474742 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.474920 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475060 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475224 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475358 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475530 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475658 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475847 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.475983 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.476155 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.476295 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.476466 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.476599 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.476770 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.476907 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.477122 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.477262 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.477444 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.477569 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.477751 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.477877 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.478056 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.478198 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.478383 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.478510 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.478698 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.478826 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479005 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479142 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479321 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479448 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479633 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479760 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.479943 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.480080 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.480250 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.480375 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.480563 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.480690 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.480876 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481010 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481180 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481306 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481485 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481612 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481812 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.481945 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.482069 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.482191 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.482408 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.482538 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.482716 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.482845 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483021 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483146 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483330 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483457 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483639 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483767 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.483944 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484070 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484244 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484387 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484554 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484682 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484859 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.484993 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.485166 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.485300 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.485474 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.485608 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.485778 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.485905 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.486081 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.486220 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.486417 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.486544 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.486726 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.486851 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487030 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487170 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487339 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487466 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487644 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487772 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.487949 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488075 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488250 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488376 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488552 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488681 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488854 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.488983 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.489160 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.489284 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.489465 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.489591 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.489768 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.489896 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.490075 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.490200 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.490407 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.490544 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.490713 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.490841 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491016 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491143 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491324 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491460 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491626 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491756 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.491928 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.492056 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.492235 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.492377 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.492563 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.493205 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.493403 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.493530 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.493710 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.493846 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494021 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494155 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494344 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494474 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494655 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494797 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.494963 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.495090 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.495273 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.495407 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.495578 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.495704 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.495882 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496011 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496186 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496312 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496489 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496616 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496792 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.496924 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497163 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497368 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497486 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497578 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497697 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497846 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.497990 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.498115 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.498366 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.498600 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.498701 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.498954 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.499103 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.499264 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.499394 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.499603 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.499729 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.499918 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500045 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500230 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500359 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500544 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500671 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500852 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.500985 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.501165 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.501300 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.501476 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.501613 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.501780 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.501909 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.502095 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.502223 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.502492 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.502642 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.502776 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.502899 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503031 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503157 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503333 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503459 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503638 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503772 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.503953 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.504079 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.504265 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.504393 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.504571 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.504709 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.504883 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505018 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505190 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505326 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505499 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505633 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505803 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.505928 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.506111 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.506236 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.506427 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.506564 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.506744 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.506878 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507054 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507180 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507365 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507503 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507678 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507805 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.507989 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.508129 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.508377 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509009 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509169 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509296 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509481 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509666 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509802 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.509987 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.510121 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.510320 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.510451 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.510639 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.510778 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.510950 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.511078 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.511261 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.511387 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.511596 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.511723 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.511891 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512019 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512200 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512338 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512506 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512634 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512811 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.512945 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.513140 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.513267 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.513450 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.513578 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.513776 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.513903 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.514135 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.514260 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.514470 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.514599 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.514786 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.514914 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.515102 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.515247 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.515408 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.515536 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.515829 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.515965 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.516141 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.516276 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.516452 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.516580 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.516763 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.516892 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.517069 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.517208 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.517373 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.517500 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.517684 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.517811 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518008 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518148 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518401 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518550 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518675 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518799 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.518931 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519057 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519242 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519385 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519547 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519674 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519870 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.519997 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.520191 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.520331 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.520519 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.520647 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.520880 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.521006 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.521253 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.521379 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.521567 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.521695 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.521891 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522018 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522228 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522383 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522549 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522677 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522857 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.522989 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.523172 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.523300 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.523479 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.523605 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.523786 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.523955 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.524142 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.524272 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.524449 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.524583 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.524766 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.524902 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525079 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525205 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525385 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525512 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525690 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525828 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.525996 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.526125 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.526326 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.526456 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.526658 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.526796 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.526984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.527122 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.527305 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.527433 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.527633 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.527761 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.527960 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.528087 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.528270 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.528398 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.528586 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.528720 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.528892 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529019 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529199 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529325 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529503 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529637 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529809 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.529936 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.530133 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.530268 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.530463 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.530601 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.530777 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.530895 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.531089 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.531225 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.531398 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.531525 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.531700 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.531826 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532003 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532143 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532324 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532451 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532626 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532753 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.532956 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.533095 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.533274 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.533401 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.533599 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.533725 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.533906 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534040 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534215 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534358 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534547 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534672 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534858 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.534986 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.535161 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.535286 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.535468 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.535594 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.535773 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.535912 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.536080 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.536207 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.536388 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.536515 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.536714 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.536841 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537021 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537146 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537348 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537485 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537659 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.537966 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.538092 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.538274 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.538510 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.538643 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.538751 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.538935 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.539061 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.539241 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.539375 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.539672 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.539809 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.539942 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.540344 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.540574 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.540777 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.554365 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.554583 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.554715 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.554841 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.554987 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.555112 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.555734 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.555858 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.555982 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556105 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556243 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556368 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556490 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556621 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556746 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.556869 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557001 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557124 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557255 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557387 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557519 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557643 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557780 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.557924 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558058 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558182 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558182 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558452 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558589 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558714 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558839 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.558959 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559092 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559224 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559348 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559479 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559611 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559736 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.559860 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560065 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560207 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560346 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560466 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560593 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560719 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560853 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.560988 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561114 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561239 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561360 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561492 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561619 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561744 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561867 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.561993 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562116 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562248 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562405 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562544 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562669 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562793 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.562917 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563054 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563179 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563311 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563443 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563577 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563781 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.563781 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564018 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564143 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564267 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564390 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564522 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564646 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564770 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.564956 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.565158 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.565355 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.565566 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.565768 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.565964 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.566171 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.566397 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.566607 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.566805 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.566984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.567160 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.567339 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.567539 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.567747 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.567921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.568108 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.568309 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.568503 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.568706 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.568919 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.569108 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.569314 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.569508 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.569704 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.569922 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.570117 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.570419 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.570419 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.570792 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.571539 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.571761 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.571961 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.572166 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.572367 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.572586 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.572792 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.573000 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.573177 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.573355 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.573531 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.573733 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.573933 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574104 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574272 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574461 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574589 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574713 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574852 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.574986 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575111 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575236 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575359 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575484 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575618 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575743 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575866 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.575989 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576119 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576256 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576381 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576512 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576644 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576752 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576875 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.576875 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577118 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577242 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577372 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577372 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577620 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577756 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.577879 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578002 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578125 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578248 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578401 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578527 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578650 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578775 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.578898 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579021 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579152 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579269 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579437 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579563 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579686 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579819 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.579954 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580071 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580199 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580323 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580467 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580592 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580728 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580854 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.580977 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581107 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581230 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581371 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581495 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581607 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581728 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581851 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.581981 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582112 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582112 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582418 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582545 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582657 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582779 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.582920 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583059 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583183 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583306 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583429 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583561 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583693 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583823 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.583946 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584077 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584201 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584342 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584467 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584591 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584725 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584850 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.584983 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585121 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585276 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585435 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585605 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585743 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585743 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.585991 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.586137 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.586362 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.586503 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.586628 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.586764 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.586898 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587024 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587149 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587273 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587404 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587543 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587668 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587792 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.587915 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588021 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588144 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588277 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588402 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588526 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588649 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588649 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.588882 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589014 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589146 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589271 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589384 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589507 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589630 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589766 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.589902 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590138 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590260 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590455 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590582 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590707 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590838 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.590838 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591080 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591285 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591421 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591421 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591663 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591786 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.591913 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592046 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592171 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592278 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592401 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592525 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592648 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592780 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.592904 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593027 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593150 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593279 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593412 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593543 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593666 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593789 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.593923 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594048 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594179 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594317 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594317 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594564 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594690 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594813 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.594946 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595070 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595337 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595462 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595594 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595718 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595849 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.595972 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596096 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596220 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596356 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596479 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596603 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596727 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596851 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.596964 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597166 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597277 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597402 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597534 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597667 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597791 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.597923 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598047 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598172 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598295 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598455 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598592 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598718 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598718 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.598951 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599074 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599205 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599338 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599451 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599572 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599705 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599829 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.599956 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600088 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600213 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600336 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600458 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600581 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600712 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600838 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.600960 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601083 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601213 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601337 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601468 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601593 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601715 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601828 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.601950 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602072 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602208 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602351 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602476 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602613 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602738 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.602946 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603105 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603237 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603369 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603493 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603616 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603616 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603858 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.603984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604106 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604230 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604361 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604539 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604672 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604804 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.604927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605051 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605181 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605314 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605446 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605571 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605701 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605825 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.605957 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606082 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606212 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606393 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606519 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606643 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606779 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.606911 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607041 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607148 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607269 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607393 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607525 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607650 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607773 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.607905 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608029 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608162 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608287 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608411 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608411 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608642 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608765 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.608896 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609020 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609145 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609268 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609392 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609392 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609615 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609747 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609872 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.609999 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610122 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610247 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610403 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610519 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610625 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610625 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610865 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.610998 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611122 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611247 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611370 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611494 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611628 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611761 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.611886 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612071 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612210 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612336 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612460 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612592 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612715 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612838 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612960 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.612960 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613199 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613333 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613465 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613589 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613711 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613843 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.613984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.614108 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.614231 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.614428 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.614556 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.614680 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.614879 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615005 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615136 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615268 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615393 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615525 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615657 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615782 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.615906 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616030 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616153 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616153 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616393 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616517 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616648 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616777 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.616901 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.617033 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.617158 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.617280 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.617403 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.617527 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618133 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618273 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618412 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618535 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618659 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.618793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619141 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619264 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619264 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619494 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619626 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619733 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619862 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.619862 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620976 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620976 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.620976 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.621437 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.621761 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.622675 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.622675 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.622952 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.623089 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.623394 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.623727 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.624345 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.624478 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.624732 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.625895 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.626219 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.626616 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.626942 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.627257 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:57:57.627511 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 13:57:57.681670 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Registered counter for database nova_api Jul 11 13:57:57.691101 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Registered counter for database nova_api Jul 11 13:57:57.793664 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:57.800748 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:57.802579 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:57.809764 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:57.856521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.context [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1758d6a-ad81-4545-a820-3e6926618f09(cell1) {{(pid=103408) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 13:57:57.860451 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 13:57:57.862046 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 13:57:57.862858 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 13:57:57.864984 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_concurrency.lockutils [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 13:57:57.865098 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.context [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1758d6a-ad81-4545-a820-3e6926618f09(cell1) {{(pid=103407) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 13:57:57.867005 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Registered counter for database nova_cell0 Jul 11 13:57:57.869931 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 13:57:57.871572 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 13:57:57.871687 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Registered counter for database nova_cell1 Jul 11 13:57:57.872399 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 13:57:57.874559 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 13:57:57.876627 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Registered counter for database nova_cell0 Jul 11 13:57:57.879732 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:57.880605 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Registered counter for database nova_cell1 Jul 11 13:57:57.881449 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:57.886646 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:57.887987 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:57.892335 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:57.893120 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:57.893769 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:58.035465 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO dbcounter [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Registered counter for database nova_cell0 Jul 11 13:57:58.036531 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:58.043004 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG oslo_db.sqlalchemy.engines [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:58.046169 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO dbcounter [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Registered counter for database nova_cell0 Jul 11 13:57:58.047562 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writer thread running {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:58.053174 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_db.sqlalchemy.engines [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:57:58.057822 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writer thread running {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:57:58.389854 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 13:57:58.390962 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 13:57:58.397137 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 13:57:58.398173 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 13:57:58.740786 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 13:57:58.740995 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 13:57:58.747450 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: WARNING keystonemiddleware.auth_token [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 13:57:58.748099 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: WARNING keystonemiddleware.auth_token [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 13:57:58.753146 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588e07339c0 pid: 103408 (default app) Jul 11 13:57:58.753505 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588e07339c0 pid: 103407 (default app) Jul 11 13:57:58.755433 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:57:58.756793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-a2da0bd9-eb33-4c62-bdac-dfbca59b2153 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001912 Jul 11 13:57:58.757537 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Jul 11 13:57:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:15.704474 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:15.705697 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jul 11 13:59:15.706112 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 13:59:15.722737 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.724406 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell1:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.726048 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=3 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.728232 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:16.811611 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-ac742e61-f4aa-41f6-9dcb-d4113d1e2bc0 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:16.846655 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-ac742e61-f4aa-41f6-9dcb-d4113d1e2bc0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.132967 Jul 11 13:59:16.847304 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 11 13:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:19.105782 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:19.106921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-813db30a-b915-4909-8a61-1e280216d1d5 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 11 13:59:19.107572 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:19.623315 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-ffc288e3-c439-4732-88a9-3721da925740 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:19.641350 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 13:59:19.641350 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 11 13:59:19.671555 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-ffc288e3-c439-4732-88a9-3721da925740 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.554369 Jul 11 13:59:19.678557 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:19.919010 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d61f7c67-e470-4283-b1a8-82a9f968e796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:19.921952 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 13:59:19.921952 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 11 13:59:19.937521 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.938511 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.939199 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell1:SELECT=3 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.939929 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.989152 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-d61f7c67-e470-4283-b1a8-82a9f968e796 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307835 Jul 11 13:59:19.989751 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 11 13:59:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:22.328708 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-ffc288e3-c439-4732-88a9-3721da925740 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:22.330509 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-ffc288e3-c439-4732-88a9-3721da925740 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002582 Jul 11 13:59:22.331283 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:23.111834 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-34555cc6-2ee8-4dca-87e2-35b09807b697 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:23.129900 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 13:59:23.129900 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 11 13:59:23.150557 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-34555cc6-2ee8-4dca-87e2-35b09807b697 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.807558 Jul 11 13:59:23.151267 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 13:59:23.165611 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-8b802a0d-acf8-4d60-ae5c-466d626db581 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:23.167132 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 13:59:23.167132 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: warnings.warn(msg) Jul 11 13:59:23.202073 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-8b802a0d-acf8-4d60-ae5c-466d626db581 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040849 Jul 11 13:59:23.209833 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 11 13:59:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:25.510213 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-34555cc6-2ee8-4dca-87e2-35b09807b697 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:25.511270 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-34555cc6-2ee8-4dca-87e2-35b09807b697 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 11 13:59:25.511953 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:25.953787 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3d753b1b-43f8-4e25-ab5d-18a927799b46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0, "disk": 10, "ram": 1024}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:25.972102 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3d753b1b-43f8-4e25-ab5d-18a927799b46 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454692 Jul 11 13:59:25.972656 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:25.984467 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-1ef2c356-3e8c-47ac-a2ad-a0afb7860574 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:26.007222 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-1ef2c356-3e8c-47ac-a2ad-a0afb7860574 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026418 Jul 11 13:59:26.007983 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 11 13:59:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:28.324929 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3d753b1b-43f8-4e25-ab5d-18a927799b46 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:28.326218 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3d753b1b-43f8-4e25-ab5d-18a927799b46 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001809 Jul 11 13:59:28.326658 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:28.885813 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-2469b0ea-ddc8-4509-bb7f-12d04a3cae3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:28.906274 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-2469b0ea-ddc8-4509-bb7f-12d04a3cae3c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.571281 Jul 11 13:59:28.907918 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 13:59:28.920202 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c854a833-afd8-4496-a6e4-362d23fe46fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:28.947568 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c854a833-afd8-4496-a6e4-362d23fe46fb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031013 Jul 11 13:59:28.948154 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 11 13:59:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:31.268401 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-2469b0ea-ddc8-4509-bb7f-12d04a3cae3c admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:31.269410 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-2469b0ea-ddc8-4509-bb7f-12d04a3cae3c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 11 13:59:31.270007 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 13:59:31.758388 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-eccfb61b-639b-4c37-bfc1-253eb889c18e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:31.780010 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-eccfb61b-639b-4c37-bfc1-253eb889c18e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502464 Jul 11 13:59:31.780664 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:31.794349 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-cf3b509f-68c0-41a9-b97b-aa4a2ebc7b72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:31.822177 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-cf3b509f-68c0-41a9-b97b-aa4a2ebc7b72 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031686 Jul 11 13:59:31.823198 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1335 bytes} [Mon Jul 11 13:59:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:34.153256 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-eccfb61b-639b-4c37-bfc1-253eb889c18e admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:34.154274 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-eccfb61b-639b-4c37-bfc1-253eb889c18e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 11 13:59:34.154728 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:34.614723 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-13b410f2-4065-4477-8a2c-a5a78ecbbd6c admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:34.640393 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-13b410f2-4065-4477-8a2c-a5a78ecbbd6c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479344 Jul 11 13:59:34.640943 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 11 13:59:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 13:59:37.218757 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-eccfb61b-639b-4c37-bfc1-253eb889c18e admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:37.219713 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-eccfb61b-639b-4c37-bfc1-253eb889c18e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 11 13:59:37.220057 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:37.667127 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-8f84891c-714d-41c6-8203-40d696daf0fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "swap": 0, "disk": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:37.685417 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-8f84891c-714d-41c6-8203-40d696daf0fa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.458773 Jul 11 13:59:37.685971 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:37.701861 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-286ed48e-8260-465e-9276-eda15ba71777 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:37.729106 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-286ed48e-8260-465e-9276-eda15ba71777 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032098 Jul 11 13:59:37.729683 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 11 13:59:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:39.961512 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-8f84891c-714d-41c6-8203-40d696daf0fa admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:39.963466 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-8f84891c-714d-41c6-8203-40d696daf0fa admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jul 11 13:59:39.963778 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:40.399345 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-360e7685-0998-41ea-b4b6-3d89dd3ead84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:40.418077 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-360e7685-0998-41ea-b4b6-3d89dd3ead84 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447862 Jul 11 13:59:40.418707 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:40.431185 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-2f3b0d4a-94d1-47b2-b2a7-d241125bef7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:40.455068 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-2f3b0d4a-94d1-47b2-b2a7-d241125bef7a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028297 Jul 11 13:59:40.455657 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 11 13:59:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:42.756691 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-360e7685-0998-41ea-b4b6-3d89dd3ead84 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:42.757638 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-360e7685-0998-41ea-b4b6-3d89dd3ead84 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 11 13:59:42.758046 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:43.171914 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-49cbc97f-e216-4f56-b0d5-721a5d3eba5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:43.198695 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-49cbc97f-e216-4f56-b0d5-721a5d3eba5b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.434635 Jul 11 13:59:43.199583 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 13:59:43.211365 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3a6bfdaf-7d71-44e4-9aba-b5fbd08aab3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:43.238055 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3a6bfdaf-7d71-44e4-9aba-b5fbd08aab3b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030341 Jul 11 13:59:43.239540 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 11 13:59:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:45.602783 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-49cbc97f-e216-4f56-b0d5-721a5d3eba5b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:45.603619 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-49cbc97f-e216-4f56-b0d5-721a5d3eba5b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 11 13:59:45.604027 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:46.085797 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-46bef719-59b1-4f8a-b60b-8667e5a8dc71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "id": "4", "disk": 80, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:46.091723 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:46.107296 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-46bef719-59b1-4f8a-b60b-8667e5a8dc71 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.497172 Jul 11 13:59:46.109940 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:46.120769 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ac4300ef-3dba-40ba-8e18-08fb471581e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:46.147267 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ac4300ef-3dba-40ba-8e18-08fb471581e0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030454 Jul 11 13:59:46.150653 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 11 13:59:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:48.462413 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-46bef719-59b1-4f8a-b60b-8667e5a8dc71 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 13:59:48.463451 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-46bef719-59b1-4f8a-b60b-8667e5a8dc71 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 11 13:59:48.464112 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 13:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 13:59:48.991764 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-6e0c5475-d593-4260-9cf4-ad3a9c7e318e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "ram": 16384, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:49.011472 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-6e0c5475-d593-4260-9cf4-ad3a9c7e318e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.541843 Jul 11 13:59:49.012657 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1282 bytes} [Mon Jul 11 13:59:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 13:59:49.024210 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-cf80ee2e-b02d-4ba1-8005-9836bad9d31e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 13:59:49.049557 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-cf80ee2e-b02d-4ba1-8005-9836bad9d31e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029034 Jul 11 13:59:49.050440 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1332 bytes} [Mon Jul 11 13:59:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:08.269211 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-6e0c5475-d593-4260-9cf4-ad3a9c7e318e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:08.270229 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-6e0c5475-d593-4260-9cf4-ad3a9c7e318e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 11 14:00:08.270668 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 14:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:08.280909 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.785021 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-c565fb8f-1c48-4ef3-996c-2d4899995db1 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:08.802563 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-c565fb8f-1c48-4ef3-996c-2d4899995db1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.525984 Jul 11 14:00:08.803112 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 11 14:00:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:00:09.851750 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-6e0c5475-d593-4260-9cf4-ad3a9c7e318e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:09.852764 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-6e0c5475-d593-4260-9cf4-ad3a9c7e318e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 11 14:00:09.853163 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:10.374050 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0982f857-d685-4538-b6f2-1f1433d1a484 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:10.379652 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-0982f857-d685-4538-b6f2-1f1433d1a484 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0982f857-d685-4538-b6f2-1f1433d1a484 admin admin] Request method failure captured: Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Host: 10.222.0.49 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABizCzpcZO9dNgHUrFKANjpZ1uqNZx9KeeE8h79pdcfBXwKvlQsnuUH1yBK3H_hi5INIa8jt1DzHMVFsPvXNpKZuTjJb6-nDgkJZg-QnCkBmQIKh429BaxTNdOgAS9yQqKd4JBh8pwwHG04maYsb_504E8EBYG54pwuEE-u9xOYgSYpgW4 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Role: admin,reader,member Jul 11 14:00:10.383521 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Roles: admin,reader,member Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5898aef39ca74b7d8b99cb1aa700e9c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}] Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User: admin Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Id: e549d830b8bf4a6d8e16e2dad340366b Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: method: > Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: exception: Flavor 42 could not be found. Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: action_args: {'id': '42'} Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:00:10.385188 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:10.386327 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.387810 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-0982f857-d685-4538-b6f2-1f1433d1a484 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:00:10.389056 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-0982f857-d685-4538-b6f2-1f1433d1a484 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394200 Jul 11 14:00:10.389056 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 11 14:00:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:00:10.394706 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-37bb747b-f552-4889-9128-0d20a81d830a admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:10.397677 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.417647 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-37bb747b-f552-4889-9128-0d20a81d830a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026464 Jul 11 14:00:10.418196 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 11 14:00:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:00:10.428793 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-4c31fd47-b294-43e7-9f97-5a843afc847c admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:10.449705 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-4c31fd47-b294-43e7-9f97-5a843afc847c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025384 Jul 11 14:00:10.450242 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 11 14:00:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:00:10.459505 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-93b96b74-e3ea-410f-a60b-333b18b24627 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:10.465927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-93b96b74-e3ea-410f-a60b-333b18b24627 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-93b96b74-e3ea-410f-a60b-333b18b24627 admin admin] Request method failure captured: Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Host: 10.222.0.49 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABizCzpcZO9dNgHUrFKANjpZ1uqNZx9KeeE8h79pdcfBXwKvlQsnuUH1yBK3H_hi5INIa8jt1DzHMVFsPvXNpKZuTjJb6-nDgkJZg-QnCkBmQIKh429BaxTNdOgAS9yQqKd4JBh8pwwHG04maYsb_504E8EBYG54pwuEE-u9xOYgSYpgW4 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Role: admin,reader,member Jul 11 14:00:10.469279 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Roles: admin,reader,member Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5898aef39ca74b7d8b99cb1aa700e9c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}] Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User: admin Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Id: e549d830b8bf4a6d8e16e2dad340366b Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: method: > Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: exception: Flavor 42 could not be found. Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: action_args: {'id': '42'} Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:00:10.470612 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:10.471497 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:10.472833 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-93b96b74-e3ea-410f-a60b-333b18b24627 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:00:10.474643 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-93b96b74-e3ea-410f-a60b-333b18b24627 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014745 Jul 11 14:00:10.474643 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 11 14:00:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:00:11.434334 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-4c31fd47-b294-43e7-9f97-5a843afc847c admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:11.435412 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-4c31fd47-b294-43e7-9f97-5a843afc847c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 11 14:00:11.435812 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:11.964121 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-4d79ae3b-b906-49aa-8c63-97618f7d8df2 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:11.970225 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-4d79ae3b-b906-49aa-8c63-97618f7d8df2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-4d79ae3b-b906-49aa-8c63-97618f7d8df2 admin admin] Request method failure captured: Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Host: 10.222.0.49 Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABizCzrqmc3lijWg2FZZ7ljT5RVGWky8Hmk5u9oA6j9gifJFf3MfGVnUHr3nPY3Vb4JC1zHPCNVL1dhbvjOBFGh9o23MZb_krodVRFsxK_VXkipSZuQIoneUBSk0q9pd3ozXJiCHohRTVCy7_1gMQ8sSRaMsOUa_zXqZwUBN0SMd1VuZoA Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Role: admin,reader,member Jul 11 14:00:11.971874 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Roles: admin,reader,member Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5898aef39ca74b7d8b99cb1aa700e9c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}] Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User: admin Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Id: e549d830b8bf4a6d8e16e2dad340366b Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: method: > Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: exception: Flavor 84 could not be found. Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: action_args: {'id': '84'} Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:00:11.973430 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:11.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:11.976026 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-4d79ae3b-b906-49aa-8c63-97618f7d8df2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:00:11.977091 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-4d79ae3b-b906-49aa-8c63-97618f7d8df2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399456 Jul 11 14:00:11.977091 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 11 14:00:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:00:11.983435 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-f48977a8-0c5d-4b95-94ba-7dce9392c161 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:11.997728 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-f48977a8-0c5d-4b95-94ba-7dce9392c161 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017820 Jul 11 14:00:11.998267 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 11 14:00:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:00:12.007611 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-add73998-8531-474d-9d02-2d25b8af4219 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:12.021637 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-add73998-8531-474d-9d02-2d25b8af4219 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017523 Jul 11 14:00:12.022169 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 11 14:00:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:00:12.031375 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-e9d8c630-cbfe-4bf8-a6f8-72b1e01a7061 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:12.037253 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-e9d8c630-cbfe-4bf8-a6f8-72b1e01a7061 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-e9d8c630-cbfe-4bf8-a6f8-72b1e01a7061 admin admin] Request method failure captured: Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Host: 10.222.0.49 Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABizCzrqmc3lijWg2FZZ7ljT5RVGWky8Hmk5u9oA6j9gifJFf3MfGVnUHr3nPY3Vb4JC1zHPCNVL1dhbvjOBFGh9o23MZb_krodVRFsxK_VXkipSZuQIoneUBSk0q9pd3ozXJiCHohRTVCy7_1gMQ8sSRaMsOUa_zXqZwUBN0SMd1VuZoA Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Role: admin,reader,member Jul 11 14:00:12.038790 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Roles: admin,reader,member Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5898aef39ca74b7d8b99cb1aa700e9c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}] Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User: admin Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Id: e549d830b8bf4a6d8e16e2dad340366b Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: method: > Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: exception: Flavor 84 could not be found. Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: action_args: {'id': '84'} Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:00:12.040316 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:12.041263 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:12.042590 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-e9d8c630-cbfe-4bf8-a6f8-72b1e01a7061 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:00:12.043800 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-e9d8c630-cbfe-4bf8-a6f8-72b1e01a7061 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012331 Jul 11 14:00:12.043800 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Jul 11 14:00:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:00:13.015934 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-add73998-8531-474d-9d02-2d25b8af4219 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:13.016967 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-add73998-8531-474d-9d02-2d25b8af4219 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jul 11 14:00:13.017378 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:13.581387 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-71b2f9f5-90c7-4a4c-889f-a1e0a246a52d admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:13.587338 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.wsgi [None req-71b2f9f5-90c7-4a4c-889f-a1e0a246a52d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-71b2f9f5-90c7-4a4c-889f-a1e0a246a52d admin admin] Request method failure captured: Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Accept: application/json Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Accept-Encoding: gzip, deflate Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Connection: keep-alive Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Content-Length: 0 Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Host: 10.222.0.49 Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Openstack-Api-Version: compute 2.90 Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Openstack-System-Scope: None Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: User-Agent: python-novaclient Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Auth-Token: gAAAAABizCzsptz0aPDSUoGugzSIqxqUSuECdDtoFfUtCXh-BMumezTCpG0N6k4DWjYfN8TcHT9rjjNgSdOvOsrQjTCz-uf0R1JmuZP_oitMQ7AlYmbt9V1MZRQX4WeXay97F1LWateMEgz2TxljcVRCGG-ZMj9kEcCxj8vdUPjnnSyvyTwdong Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Domain-Id: None Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Domain-Name: None Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Identity-Status: Confirmed Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Is-Admin-Project: True Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Id: default Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Domain-Name: Default Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Project-Name: admin Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Role: admin,reader,member Jul 11 14:00:13.588875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Roles: admin,reader,member Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5898aef39ca74b7d8b99cb1aa700e9c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}] Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant: admin Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-Tenant-Name: admin Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User: admin Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Id: default Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Domain-Name: Default Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Id: e549d830b8bf4a6d8e16e2dad340366b Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: X-User-Name: admin Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: method: > Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: exception: Flavor 451 could not be found. Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: action_args: {'id': '451'} Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:00:13.590481 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:13.591830 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.593200 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-71b2f9f5-90c7-4a4c-889f-a1e0a246a52d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:00:13.594492 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-71b2f9f5-90c7-4a4c-889f-a1e0a246a52d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433560 Jul 11 14:00:13.594492 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 11 14:00:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:00:13.600583 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-14eab9bf-059a-4903-bd4d-2d7f23d591bf admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:13.615222 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-14eab9bf-059a-4903-bd4d-2d7f23d591bf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018051 Jul 11 14:00:13.615752 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 11 14:00:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:00:13.625642 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:13.640952 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018953 Jul 11 14:00:13.641511 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Jul 11 14:00:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:00:13.651185 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d08bf512-55ad-4a35-ba59-e3b42a320a92 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:13.656988 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.wsgi [None req-d08bf512-55ad-4a35-ba59-e3b42a320a92 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d08bf512-55ad-4a35-ba59-e3b42a320a92 admin admin] Request method failure captured: Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Accept: application/json Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Accept-Encoding: gzip, deflate Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Connection: keep-alive Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Content-Length: 0 Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Host: 10.222.0.49 Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Openstack-Api-Version: compute 2.90 Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Openstack-System-Scope: None Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: User-Agent: python-novaclient Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Auth-Token: gAAAAABizCzsptz0aPDSUoGugzSIqxqUSuECdDtoFfUtCXh-BMumezTCpG0N6k4DWjYfN8TcHT9rjjNgSdOvOsrQjTCz-uf0R1JmuZP_oitMQ7AlYmbt9V1MZRQX4WeXay97F1LWateMEgz2TxljcVRCGG-ZMj9kEcCxj8vdUPjnnSyvyTwdong Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Domain-Id: None Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Domain-Name: None Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Identity-Status: Confirmed Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Is-Admin-Project: True Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Openstack-Nova-Api-Version: 2.90 Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Id: default Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Domain-Name: Default Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Project-Name: admin Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Role: admin,reader,member Jul 11 14:00:13.658567 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Roles: admin,reader,member Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5898aef39ca74b7d8b99cb1aa700e9c2", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5898aef39ca74b7d8b99cb1aa700e9c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5898aef39ca74b7d8b99cb1aa700e9c2"}]}] Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant: admin Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant-Id: 5898aef39ca74b7d8b99cb1aa700e9c2 Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-Tenant-Name: admin Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User: admin Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Id: default Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Domain-Name: Default Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Id: e549d830b8bf4a6d8e16e2dad340366b Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: X-User-Name: admin Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: method: > Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: exception: Flavor 451 could not be found. Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: action_args: {'id': '451'} Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:00:13.660118 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:13.660927 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: ERROR nova.api.openstack.wsgi Jul 11 14:00:13.662588 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d08bf512-55ad-4a35-ba59-e3b42a320a92 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:00:13.663589 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-d08bf512-55ad-4a35-ba59-e3b42a320a92 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012458 Jul 11 14:00:13.663589 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 11 14:00:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 11 14:00:14.669966 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:14.671022 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 11 14:00:14.671600 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:15.220038 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-abdf4144-26e4-4eb2-9353-fd6f9474712c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:00:15.237416 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-abdf4144-26e4-4eb2-9353-fd6f9474712c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.426146 Jul 11 14:00:15.237952 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 11 14:00:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:16.205842 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:16.206875 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 11 14:00:16.207275 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:16.780273 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-0a2495fd-022c-4836-97ee-4cc35caa3a07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:00:16.800651 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-0a2495fd-022c-4836-97ee-4cc35caa3a07 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.451687 Jul 11 14:00:16.801207 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 11 14:00:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:17.895365 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:17.896862 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jul 11 14:00:17.897265 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:18.424953 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-c501be69-f690-4bee-9d3b-1d0af772479c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:00:18.442441 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-c501be69-f690-4bee-9d3b-1d0af772479c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407844 Jul 11 14:00:18.443596 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 11 14:00:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:00:19.421682 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:19.422728 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 11 14:00:19.423122 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:19.951822 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-efe5c899-1cf1-4662-bf90-c728f805487e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:00:19.970486 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-efe5c899-1cf1-4662-bf90-c728f805487e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.405779 Jul 11 14:00:19.970959 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Jul 11 14:00:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:20.945758 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:20.946797 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 11 14:00:20.947190 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:00:21.476019 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-465c429e-1dcc-4bb4-8588-2b69479f9a68 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:00:21.495597 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-465c429e-1dcc-4bb4-8588-2b69479f9a68 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408376 Jul 11 14:00:21.496060 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Jul 11 14:00:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:01:13.973117 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:01:13.974123 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-699f9c92-af1c-4d73-9242-78326bde564f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Jul 11 14:01:13.974573 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 930 bytes} [Mon Jul 11 14:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:01:13.984957 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:14.364483 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-ae0a3d9b-9de5-49c7-ad34-262eeac6241e admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:01:14.384066 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-ae0a3d9b-9de5-49c7-ad34-262eeac6241e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403514 Jul 11 14:01:14.384615 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1291 bytes} [Mon Jul 11 14:01:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:01:14.408274 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG dbcounter [-] [103408] Writing DB stats nova_api:SELECT=14 {{(pid=103408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:14.412056 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-3a8b8463-2dea-49b1-a96a-8da6e8cefe6f admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:01:14.419698 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-3a8b8463-2dea-49b1-a96a-8da6e8cefe6f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014079 Jul 11 14:01:14.420219 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Jul 11 14:01:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:01:14.432062 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-e5ddd3f4-d360-463a-8585-94aa772919c3 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:01:14.440007 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-e5ddd3f4-d360-463a-8585-94aa772919c3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011828 Jul 11 14:01:14.441027 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Jul 11 14:01:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:01:14.452113 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:01:14.460252 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011620 Jul 11 14:01:14.460761 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1285 bytes} [Mon Jul 11 14:01:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:01:14.471644 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-33a9ac17-7a9e-4f19-90da-0e665f18618b admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:01:14.479185 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-33a9ac17-7a9e-4f19-90da-0e665f18618b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011031 Jul 11 14:01:14.479699 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1282 bytes} [Mon Jul 11 14:01:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:04:47.478225 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:04:47.479280 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 11 14:04:47.479687 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:04:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:04:47.622160 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=6 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:47.785518 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-5b3e03c1-f9f2-4009-b9aa-9b3bf8993129 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:04:47.786856 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:04:47.786856 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 11 14:04:47.788055 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-5b3e03c1-f9f2-4009-b9aa-9b3bf8993129 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:47.788488 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-5b3e03c1-f9f2-4009-b9aa-9b3bf8993129 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:47.789360 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-5b3e03c1-f9f2-4009-b9aa-9b3bf8993129 admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:47.789827 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-5b3e03c1-f9f2-4009-b9aa-9b3bf8993129 admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:47.825030 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-5b3e03c1-f9f2-4009-b9aa-9b3bf8993129 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204287 Jul 11 14:04:47.825625 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 11 14:04:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:04:48.665207 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:04:48.666197 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 11 14:04:48.666629 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:04:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:04:48.854382 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-08f8a568-e623-49bc-aedf-af5fa044b3be admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:04:48.855604 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:04:48.855604 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 11 14:04:48.856854 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-08f8a568-e623-49bc-aedf-af5fa044b3be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:48.857300 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-08f8a568-e623-49bc-aedf-af5fa044b3be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:48.858117 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-08f8a568-e623-49bc-aedf-af5fa044b3be admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:04:48.858575 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-08f8a568-e623-49bc-aedf-af5fa044b3be admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:04:48.878692 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-08f8a568-e623-49bc-aedf-af5fa044b3be admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076590 Jul 11 14:04:48.879195 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 36/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 11 14:04:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:05:00.126628 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:00.127636 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 11 14:05:00.128037 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:05:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:00.272547 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell0:SELECT=4 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:00.273270 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_cell1:SELECT=4 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:00.274207 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG dbcounter [-] [103407] Writing DB stats nova_api:SELECT=8 {{(pid=103407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:00.325939 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-51c0be81-17ec-447a-a23f-bcaa7c0380c3 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:00.327698 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:05:00.327698 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 11 14:05:00.328831 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-51c0be81-17ec-447a-a23f-bcaa7c0380c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:05:00.329267 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-51c0be81-17ec-447a-a23f-bcaa7c0380c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:05:00.330082 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-51c0be81-17ec-447a-a23f-bcaa7c0380c3 admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:05:00.330533 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-51c0be81-17ec-447a-a23f-bcaa7c0380c3 admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:05:00.356743 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-51c0be81-17ec-447a-a23f-bcaa7c0380c3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088577 Jul 11 14:05:00.357424 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 11 14:05:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:05:01.199354 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: DEBUG nova.api.openstack.wsgi [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] Calling method '>' {{(pid=103408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:01.200353 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: INFO nova.api.openstack.requestlog [None req-110e445f-e5c6-4704-814f-6cca641f4bb6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 11 14:05:01.200742 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: [pid: 103408|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Jul 11 14:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:05:01.395957 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG nova.api.openstack.wsgi [None req-d951dd4f-cffd-4fec-b5a5-2a5075fe4d57 admin admin] Calling method '>' {{(pid=103407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:05:01.397180 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:05:01.397180 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: warnings.warn(msg) Jul 11 14:05:01.398451 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-d951dd4f-cffd-4fec-b5a5-2a5075fe4d57 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:05:01.398955 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-d951dd4f-cffd-4fec-b5a5-2a5075fe4d57 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:05:01.399783 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-d951dd4f-cffd-4fec-b5a5-2a5075fe4d57 admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:05:01.400207 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: DEBUG oslo_concurrency.lockutils [None req-d951dd4f-cffd-4fec-b5a5-2a5075fe4d57 admin admin] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:05:01.422903 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: INFO nova.api.openstack.requestlog [None req-d951dd4f-cffd-4fec-b5a5-2a5075fe4d57 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081442 Jul 11 14:05:01.423483 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: [pid: 103407|app: 0|req: 38/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Jul 11 14:05:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:05:59.760398 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: Mon Jul 11 14:05:59 2022 - graceful shutdown triggered... Jul 11 14:05:59.760914 dv-cinder-848429-3-iscsi devstack@n-api.service[103407]: Gracefully killing worker 1 (pid: 103407)... Jul 11 14:05:59.760509 dv-cinder-848429-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 11 14:05:59.762007 dv-cinder-848429-3-iscsi devstack@n-api.service[103408]: Gracefully killing worker 2 (pid: 103408)... Jul 11 14:06:00.761450 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: worker 1 buried after 1 seconds Jul 11 14:06:00.761450 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: worker 2 buried after 1 seconds Jul 11 14:06:00.762165 dv-cinder-848429-3-iscsi devstack@n-api.service[103406]: goodbye to uWSGI. Jul 11 14:06:00.763005 dv-cinder-848429-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 11 14:06:00.763568 dv-cinder-848429-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 11 14:06:00.766497 dv-cinder-848429-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 11 14:06:00.777941 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 14:06:00 2022] *** Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: nodename: dv-cinder-848429-3-iscsi Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: machine: x86_64 Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: clock source: unix Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: pcre jit disabled Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: detected number of CPU cores: 4 Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: current working directory: / Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: detected binary path: /usr/bin/uwsgi-core Jul 11 14:06:00.779935 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: your processes number limit is 47680 Jul 11 14:06:00.780650 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: your memory page size is 4096 bytes Jul 11 14:06:00.780650 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: detected max file descriptor number: 2048 Jul 11 14:06:00.780650 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: lock engine: pthread robust mutexes Jul 11 14:06:00.780650 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: thunder lock: enabled Jul 11 14:06:00.780650 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 11 14:06:00.780650 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 14:06:00.830431 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: Python main interpreter initialized at 0x561f465e29c0 Jul 11 14:06:00.830431 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: python threads support enabled Jul 11 14:06:00.830431 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: your server socket listen backlog is limited to 100 connections Jul 11 14:06:00.830431 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: your mercy for graceful operations on workers is 90 seconds Jul 11 14:06:00.830863 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 14:06:00.830863 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: *** Operational MODE: preforking *** Jul 11 14:06:00.831176 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: *** uWSGI is running in multiple interpreter mode *** Jul 11 14:06:00.831176 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: spawned uWSGI master process (pid: 117957) Jul 11 14:06:00.831371 dv-cinder-848429-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 11 14:06:00.832330 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: spawned uWSGI worker 1 (pid: 117980, cores: 1) Jul 11 14:06:00.832330 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: spawned uWSGI worker 2 (pid: 117981, cores: 1) Jul 11 14:06:00.832330 dv-cinder-848429-3-iscsi devstack@n-api.service[117957]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 14:06:01.490894 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 14:06:01.499518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 11 14:06:02.683019 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:06:02.683019 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: from cryptography.utils import int_from_bytes Jul 11 14:06:02.683688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:06:02.683688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: from cryptography.utils import int_from_bytes Jul 11 14:06:02.696439 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:06:02.696439 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: from cryptography.utils import int_from_bytes Jul 11 14:06:02.696962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 14:06:02.696962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: from cryptography.utils import int_from_bytes Jul 11 14:06:05.030224 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:06:05.030930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:06:05.031038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:06:05.031396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:06:05.031655 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:06:05.032020 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 14:06:05.032409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.032502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 14:06:05.032600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.032693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.032788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 14:06:05.032981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.033152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 14:06:05.033315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.033428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 14:06:05.033634 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.033792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.033960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.034134 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.034888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035313 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.035959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.036070 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-3-iscsi {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.036281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.036385 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.036646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.036748 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.036915 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037023 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037184 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037832 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848429-3-iscsi {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.037930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.038138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.038243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.038478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.038675 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.040123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.040123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.040597 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.040845 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.041054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.041292 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.041536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.041859 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.042108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.042108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.042576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.042889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.043148 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.043384 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.043643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.043866 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.044161 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.044391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.044617 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.044839 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.045067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.045263 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-3-iscsi {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.045444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.045668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.045857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046076 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046238 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.046985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.047289 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848429-3-iscsi {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.047451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.047608 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.047763 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.047963 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.048116 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.048261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.048420 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.048580 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.048727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.048879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.049024 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.049181 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.049807 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.050556 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.050748 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.050917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051074 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.051985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.052451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.052617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.052764 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.052915 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.052915 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.053212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.053377 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.053534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.053680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.053831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.053976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.054120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.054278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.054486 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.054646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.054802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.054956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.055137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.055284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.055438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.055590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.055747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.055901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056214 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056360 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.056985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.057277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.057424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.057577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.057756 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.057926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.058074 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.058225 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.058512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.058670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.058670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.058982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.059884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.060159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.060159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.060459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.060605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.060605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.060892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061047 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061496 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.061943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.062093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.062248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.062416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.062583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.062739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.062887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.063795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.064092 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.064247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.064399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.064552 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.064710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.064871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065169 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065653 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.065964 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.066117 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.066273 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.066471 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.066627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.066798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.066952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.067107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.067253 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.067406 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.067562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.067780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.067936 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.068084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.068283 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.068437 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.068605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.068772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.068925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069074 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069377 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069830 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.069976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.070130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.070284 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.070471 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.070635 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.070810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.070958 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.071113 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.071261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.071408 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.071553 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.071709 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.071938 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.072093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.072251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.072408 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.072573 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.072731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.072889 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073181 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073491 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.073936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.074098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.074252 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.074453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.074611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.074759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.074915 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.075076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.075076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.076401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.076401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.076698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.076698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077629 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.077951 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.078106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.078260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.078433 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.078593 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.078749 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.078896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079212 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079505 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079660 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.079982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.080129 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.080282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.080436 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.080593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.080593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.080870 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.081016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.081206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.081373 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.081521 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.081675 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.081832 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.081994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.081994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.082937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.083089 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.083250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.083397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 14:06:05.083543 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.083700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.083855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084404 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084552 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.084856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.085143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.085298 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.085454 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.085609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.085755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.085902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.086047 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.086202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.086380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.086542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.086745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.086903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087664 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087811 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.087965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.088250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.088250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.088250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.088250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.088250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.088959 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.089107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.089269 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.089416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.089561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.089706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.089859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.090019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.090186 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.090474 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.090637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.090785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.090938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.091100 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.091254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.091407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.091561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.091714 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.091860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092658 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092805 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.092965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.093111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.093258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.093409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.093562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.093718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.093864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094018 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094356 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094681 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094836 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.094983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.095129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.095284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.095430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.095585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.095771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.095929 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.096076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.096238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.096401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.096566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.096745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.097397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.097552 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.097698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.097844 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.098960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.099105 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.099275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.099448 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.099614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.099840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.099999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.100153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.100306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.100453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.100600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.100758 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.100920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.101075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.101231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.101386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.101540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.101698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.101845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102004 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102333 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102510 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.102975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.103128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.103274 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.103429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.103576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.103722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.103875 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104329 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.104931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105077 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105242 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105543 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105835 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.105990 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.106137 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.106290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.106520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.106667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.106836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.106993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.107147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.107294 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.107441 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.107594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.107748 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.107913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108068 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.108897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.109183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.109375 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.109523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.109679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.109833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.109989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.110144 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.110316 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.110472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.110735 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.110909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111367 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.111967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.112114 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.112267 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.112474 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.113131 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.113288 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.113446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.113592 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.113745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.113907 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114068 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114677 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114833 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.114986 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.115138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.115285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.115447 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.115861 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116322 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116322 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.116890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.117037 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.117190 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.117190 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.117539 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.117539 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.117539 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.118013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.118167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.118378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.118545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.118746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.118907 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119210 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119364 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119512 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.119987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.120142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.120288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.120435 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.120591 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.120739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.120884 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.121030 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.121232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.121395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.121603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.121771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.121926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.122080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.122234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.122417 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.122577 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.122787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.122968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.123134 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.123282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.123443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.123598 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.123745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.123908 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124055 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124368 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124662 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124815 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.124969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.125193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.125362 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.125567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.125730 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.125892 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.126050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.126211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.126440 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.126652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.126811 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.126965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.127111 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.127311 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.127508 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.127657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.127804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.127804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.128146 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.128358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.128549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.128696 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.128843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.128997 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.129185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.129348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.129496 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.129642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.129788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.129942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.130209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.130482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.130632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.130789 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.130948 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.131095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.131256 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.131411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.131565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.131712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.131858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132004 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132305 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132475 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132634 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.132928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.133089 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.133236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.133388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.133542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.133722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.133895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.134052 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.134207 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.134373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.134547 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.134702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.134865 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135019 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135321 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135321 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135614 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.135923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136070 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136694 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136841 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.136994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.137140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.137302 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.137462 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.137634 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.137796 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.137950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.138102 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.138102 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.138473 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.138640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.138793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.138945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.139108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.139261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.139430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.139591 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.139591 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.139890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140528 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.140982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.141134 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.141294 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.141456 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.141616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.141777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.141929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.142095 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.142247 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.142424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.142609 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.142775 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.142928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.143089 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.143252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.143413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.143573 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.143765 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.143918 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.144084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.144245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.144412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.144574 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.144738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.144898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.145065 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.145217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.145378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.145530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.145701 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.145872 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146026 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146186 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.146996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.147295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.147448 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.147608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.147771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.147926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.148079 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.148240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.148394 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.148556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.148720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.148882 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149036 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149362 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149523 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.149987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.150209 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.150455 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.150615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.150777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.150990 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.151145 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.151298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.151451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.151604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.151768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.151924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.152078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.152237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.152400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.152572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.152780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.152945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.153111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.153272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.153426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.153593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.153754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.153908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.154071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.154232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.154412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.154579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.154740 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.154901 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.155057 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.155239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.155407 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.155571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.155725 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.155885 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156836 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.156996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.157175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.157345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.157506 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.157667 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.157822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.157982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.158135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.158359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.158536 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.158700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.158854 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.159007 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.159167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.159865 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.160029 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.160184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.160345 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.160499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.160724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.160968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.161125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.161289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.161452 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.161606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.161768 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.161943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.162108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.162262 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.162443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.162609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.162773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.162928 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.163091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.163244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.163404 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.163566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.163729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.163891 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.164055 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.164216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.164381 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.164544 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.164706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.164861 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165498 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165653 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165807 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.165959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.166261 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.166497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.166665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.166820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167031 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167297 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167715 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.167985 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.168246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.168428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.168521 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.168626 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.168767 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.168924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169368 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169484 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169579 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169761 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.169948 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170748 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.170960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171233 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.171872 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172000 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172227 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172314 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172492 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.172874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173027 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173311 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173532 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.173938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.174736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.175550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.175550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.175813 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.175924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176022 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176296 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.176975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177076 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177618 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177701 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.177952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178145 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.178961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179375 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179659 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179799 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.179956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180327 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180422 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180519 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180792 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.180995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181089 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181687 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.181935 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182007 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182077 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182148 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182218 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182467 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182592 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.182883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183021 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183166 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183289 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183776 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.183917 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184063 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184466 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.184896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.185838 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.185976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186541 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186684 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186817 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.186952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187260 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187260 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187260 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187260 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.187933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.188073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.188222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.188440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.188675 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.188847 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.189056 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.189267 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.189435 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.189605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.189856 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.190020 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.190191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.190373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.190579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.190769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.190984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.191204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.192617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.192617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.192617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.192617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.193431 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.193635 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.193635 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.193993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.193993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.194383 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.194383 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.194801 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.195022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.195262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.196104 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.196332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.196549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.196823 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.197067 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.197343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.197565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.197797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.198021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.198021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.198502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.198728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.198728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.199142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.199371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.199580 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.199801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.200035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.200266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.200266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.200686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.200902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.200902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.201332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.201545 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.201762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.201990 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.201990 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.202428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.202584 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.202746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.202884 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.202884 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.202884 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.203395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.203574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.203754 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.203918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.203918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.203918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.204348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.204519 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.204694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.204869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.204869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205316 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205456 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.205824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.206872 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207150 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207549 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.207954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208089 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.208751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209153 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209294 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.209900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.210177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.210447 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.210584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.210733 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.210733 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.210733 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211540 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.211950 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212786 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.212920 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213969 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.213969 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.214239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.218339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.218493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.218614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.218723 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.218814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.218912 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219237 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219317 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219389 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219389 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219529 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219757 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.219904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220151 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220310 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220533 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220676 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.220962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221265 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221338 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221496 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221570 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.221648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.222250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.222372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.222452 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.222524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223235 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223312 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223394 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223468 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223793 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.223942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.224100 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.224259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.224422 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.224570 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.224718 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.224876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.225032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.225189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.225339 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.225486 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.225639 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.225864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.226030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.226525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.226719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.227059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.227233 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.227390 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.227550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.227896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.228062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.228212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.228506 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.228670 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.228861 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.229200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.229355 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.229641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.229806 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.230088 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.230244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.230481 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.230646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.230803 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.231001 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.231175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.231397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.231561 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.231797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.231964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.232221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.232386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.232634 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.232896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.233247 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.233451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.233613 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.233763 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.233920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.234133 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.234294 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.234488 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.234650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.234907 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.235075 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.235227 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.235374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.235550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.235715 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.235864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.236012 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.236207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.236380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.236822 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.236992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.237371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.237565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.237716 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.238568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.238750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.238939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.239093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.239241 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.239397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.239545 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.239705 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.239874 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.240023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.240177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.240325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.240496 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.240807 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.240979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.241130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.241277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.241432 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.241590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.241745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.241900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.242059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.242214 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.242498 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.242669 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.242851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.243054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.243209 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.243408 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.243571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.243732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.243880 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.244035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.244196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.244412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.244584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.244737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.244891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245046 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245670 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.245978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.246136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.246451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.246643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.247012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.247167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.247167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.247655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.247818 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.247967 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248268 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248580 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.248900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.249178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.249324 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.249472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.249632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.249781 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.249928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.250082 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.250236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.250421 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.250584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.250738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.250997 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.251161 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.251161 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.251449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.251606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.251760 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.251915 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.252072 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.252220 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.252454 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.252605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.252763 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.252911 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.253097 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.253247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.253403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.253559 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.253559 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.253856 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254003 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254158 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254681 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254845 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.254993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.255153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.255302 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.255455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.255607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.255762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.255910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.256066 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.256066 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.256353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.256500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.256652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.256817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.257207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.257371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.257746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.257910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.258059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.258219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.258399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.258553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.258699 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.258855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.259003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.259215 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.259468 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.259973 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.260140 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.260290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.260290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.260590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.260739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.260894 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.261164 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.261318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.261464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.261627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.261846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.262011 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.262191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.262387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.262661 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.262986 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.263142 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.263397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.263560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.263708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.263974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.264140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.264455 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.264622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.264778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.264987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.265160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.265404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.265568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.265799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.265962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.266120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.266289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.266528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.266685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.266875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.267030 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.267432 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.267597 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.267971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.268125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.268281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.268430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.268613 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.268779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.268779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.269077 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.269223 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.269390 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.269547 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.269702 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.269855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.270003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.270149 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.270343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.270539 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.270694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.270876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.271037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.271219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.271480 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.271652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.271801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.271946 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.272101 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.272255 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.272416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.272566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.272713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.272866 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.273022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.273168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.273331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.273680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.273844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.274029 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.274191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.274415 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.274573 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.274729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.274878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275489 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275636 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.275950 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.276157 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.276326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.276476 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.276631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.276959 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.277123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.277521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.277694 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.277862 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.278224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.278430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.278581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.278743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.278893 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.278893 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.279181 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.279326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.279473 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.279633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.279780 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.279934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280082 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280236 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280851 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.280997 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.281144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.281300 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.281474 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.281725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.281878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.282026 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.282172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.282382 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.282548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.282697 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.282852 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283000 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283302 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283598 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.283891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.284048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.284705 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.285125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.285304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.285535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.285719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.285963 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.286124 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.286124 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.286450 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.286599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.286746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.286909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.287068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.287237 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.287393 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.287773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.287773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.288097 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.288453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.288606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.288753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.288909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289375 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289529 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.289978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.290275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.290458 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.290608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.290608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.290902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.290902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.291209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.291365 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.291536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.291725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.292054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.292219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.292373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.292526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.292686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.292853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293329 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293634 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.293970 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.294130 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.294283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.294522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.294686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.297204 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.297403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.297567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.297982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.298151 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.298350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.298740 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.298924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.299079 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.299240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.299401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.299569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.299733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.300044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.300712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.300880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.301034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.301231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.301231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.301548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.301710 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.301710 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.302151 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.302662 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.302829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.302986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.302986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.303276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.303446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.303616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.303778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.303933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.304098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.304251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.304251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.304559 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.304720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.304883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305499 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.305980 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.306149 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.306337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.306510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.306672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.306834 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.307000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.307165 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.307320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.307480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.307644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.307798 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.308207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.308398 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.308554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.308947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.309109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.309264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.309428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.309584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.309738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.309890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310206 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.310726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.311947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.311947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.311947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.311947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.312688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.312688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.312688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.313188 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.313350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.313584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.313957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.314524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.314961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.315378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.315919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.316253 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.316618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.316981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.317442 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.317894 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.318075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 14:06:05.318551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 14:06:05.470169 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Registered counter for database nova_api Jul 11 14:06:05.478947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Registered counter for database nova_api Jul 11 14:06:05.491770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.499262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.499606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.506863 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.557749 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.context [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1758d6a-ad81-4545-a820-3e6926618f09(cell1) {{(pid=117980) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 14:06:05.561642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:06:05.563298 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:06:05.564115 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:06:05.565144 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.context [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1758d6a-ad81-4545-a820-3e6926618f09(cell1) {{(pid=117981) load_cells /opt/stack/nova/nova/context.py:464}} Jul 11 14:06:05.566650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:06:05.568649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Registered counter for database nova_cell0 Jul 11 14:06:05.569643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:06:05.571396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:06:05.572249 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:06:05.572736 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Registered counter for database nova_cell1 Jul 11 14:06:05.574163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:06:05.576271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Registered counter for database nova_cell0 Jul 11 14:06:05.579999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.580583 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Registered counter for database nova_cell1 Jul 11 14:06:05.581290 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.587633 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.587955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.590189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.594871 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.598030 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.728061 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.738798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO dbcounter [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Registered counter for database nova_cell0 Jul 11 14:06:05.745615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_db.sqlalchemy.engines [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.746326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO dbcounter [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Registered counter for database nova_cell0 Jul 11 14:06:05.750391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writer thread running {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:05.753519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_db.sqlalchemy.engines [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 14:06:05.758376 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writer thread running {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 14:06:06.074454 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:06:06.083335 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:06:06.083868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:06:06.090777 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:06:06.433017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:06:06.439346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: WARNING keystonemiddleware.auth_token [None req-0e1cc47b-1aaa-431e-ba99-62125b59610c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:06:06.445410 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f465e29c0 pid: 117980 (default app) Jul 11 14:06:06.447507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 11 14:06:06.453608 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: WARNING keystonemiddleware.auth_token [None req-ada35bce-d0a8-49c5-84d2-99ba6b920986 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 11 14:06:06.459586 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561f465e29c0 pid: 117981 (default app) Jul 11 14:06:48.041059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:48.041992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:48.043246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:48.044031 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:49.321137 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8309ce03-893a-4c13-9b95-6d6d27003e9c tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Action: 'create', calling method: .version_select at 0x7ffad71935e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-862475891"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:51.440009 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8309ce03-893a-4c13-9b95-6d6d27003e9c tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.409277 Jul 11 14:06:51.456609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1154 bytes} [Mon Jul 11 14:06:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 14:06:51.731425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f14ee8f7-615e-48a6-9f49-b4ec28a625af tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad72be1f0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:51.761767 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:51.762918 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:51.764600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:51.765818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:52.133245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f14ee8f7-615e-48a6-9f49-b4ec28a625af tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 200 len: 344 microversion: 2.1 time: 0.681172 Jul 11 14:06:52.139067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:06:51 2022] GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 344 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:53.147154 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aeeaaa62-3432-452a-b8b8-6b02858b32b1 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad70584c0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:53.225168 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aeeaaa62-3432-452a-b8b8-6b02858b32b1 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 200 len: 345 microversion: 2.1 time: 0.082421 Jul 11 14:06:53.225743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:06:53 2022] GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:53.239397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ccf4eb45-83fb-4ef0-818f-bed31c5c6379 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Action: 'create', calling method: .version_select at 0x7ffad70bd430>, body: {"snapshot": {"volume_id": "bdac846e-ba25-4b1d-b1f7-d595a17f5188", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1981108737"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:06:54.022637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ccf4eb45-83fb-4ef0-818f-bed31c5c6379 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.788283 Jul 11 14:06:54.036641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 2/4] 10.222.0.49 () {60 vars in 1161 bytes} [Mon Jul 11 14:06:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:54.038192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9b2856ae-25a4-47cf-84e2-fe9111e3d635 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad7058820>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:54.109646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9b2856ae-25a4-47cf-84e2-fe9111e3d635 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.078185 Jul 11 14:06:54.110532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:54 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:54.122291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6360b7a9-26ec-4fd5-8b00-47637ddd7d07 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad70bdc10>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:54.210599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6360b7a9-26ec-4fd5-8b00-47637ddd7d07 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.092778 Jul 11 14:06:54.211341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1139 bytes} [Mon Jul 11 14:06:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:54.221674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-59f3f611-f6b3-48fe-932e-c0cc1f3a048a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad7058ca0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:54.273921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-59f3f611-f6b3-48fe-932e-c0cc1f3a048a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.056036 Jul 11 14:06:54.274514 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:54 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:55.287390 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-80e474d3-c94a-4d2e-ad2b-d3d293043751 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad705f9d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:55.496489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-80e474d3-c94a-4d2e-ad2b-d3d293043751 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.213732 Jul 11 14:06:55.498209 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:55 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:06:56.510135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aa811f66-5de2-49b0-917c-cea3145781fa tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad70713a0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:56.614460 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aa811f66-5de2-49b0-917c-cea3145781fa tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.108711 Jul 11 14:06:56.615299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 5/9] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:56 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:57.627194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b1044c1f-daf2-467d-b059-45599bde78b4 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad705f670>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:57.693602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b1044c1f-daf2-467d-b059-45599bde78b4 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.071627 Jul 11 14:06:57.694403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 5/10] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:57 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:58.706688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-77d438ce-64ed-4190-a9db-63fe602aac55 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad7058ca0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:58.761581 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-77d438ce-64ed-4190-a9db-63fe602aac55 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.060311 Jul 11 14:06:58.762201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:58 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:06:59.773923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-58770956-6c1f-4fbb-8efe-632be4389acf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad7110670>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:06:59.824668 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-58770956-6c1f-4fbb-8efe-632be4389acf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.054623 Jul 11 14:06:59.829066 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:06:59 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:00.839075 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d79c27ff-df14-47d3-be8f-feb9dfe9a73e tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad7058790>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:00.939207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d79c27ff-df14-47d3-be8f-feb9dfe9a73e tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 288 microversion: 2.1 time: 0.106102 Jul 11 14:07:00.940258 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:07:00 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:00.957403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ca2e3aa0-b9cf-4fd0-9f01-ed8c03746bc4 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad70bddc0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:01.137032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ca2e3aa0-b9cf-4fd0-9f01-ed8c03746bc4 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 202 len: 0 microversion: 2.1 time: 0.190725 Jul 11 14:07:01.137596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 7/14] 10.222.0.49 () {58 vars in 1253 bytes} [Mon Jul 11 14:07:00 2022] DELETE /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:07:01.146684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-198a90c4-edc5-43ac-892d-6f83857ca2f7 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad70714c0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:01.214361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-198a90c4-edc5-43ac-892d-6f83857ca2f7 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.072167 Jul 11 14:07:01.219673 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:07:01 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:02.238572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1937262276", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:02.244483 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-96bbe6bf-2d4f-4a55-8092-e7ac8c2027e2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: .version_select at 0x7ffad705fee0>, body: {"keypair": {"name": "tempest-keypair-401273566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEHjdpq9ZaAvYS42/Yju+yf3e78V2kNS5dylPDPxsDkgmvWnO0B7nQCsnMTehjKkktl7lMSQ6IMOSex5Ms3zJZh2Ryy82UU0rhF2ZpwXjKeYi9UG85WjiyQqGFY7I8/Zw=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:02.437076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-96bbe6bf-2d4f-4a55-8092-e7ac8c2027e2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:02.455613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-96bbe6bf-2d4f-4a55-8092-e7ac8c2027e2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:02.468668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] validate_networks() for [('c944d348-d5b7-4b6c-9be2-cb2a59820444', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:02.551724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-96bbe6bf-2d4f-4a55-8092-e7ac8c2027e2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.619873 Jul 11 14:07:02.559765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 8/16] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:07:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:02.567220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d3f1f1a0-8998-47d7-9b84-29e9dc3f1853 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad6fc29d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:02.645487 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d3f1f1a0-8998-47d7-9b84-29e9dc3f1853 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.083718 Jul 11 14:07:02.646840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 9/17] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:07:02 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:03.658131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-05315f87-87be-4209-8605-d584029ae00d tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad6ff2040>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:03.786152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-05315f87-87be-4209-8605-d584029ae00d tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.132592 Jul 11 14:07:03.790416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 10/18] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:07:03 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:04.799996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-320ce222-2766-448d-bc9d-78283bf7e4b4 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad6ff2700>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:04.881202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-320ce222-2766-448d-bc9d-78283bf7e4b4 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 200 len: 287 microversion: 2.1 time: 0.086459 Jul 11 14:07:04.882610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 11/19] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:07:04 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:04.947322 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:04.947977 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:04.948556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:04.949183 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:04.949812 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:04.977521 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:04.983508 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:04.988720 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:04.989493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:05.077199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for project 4b181bc391914f6abcea09b894b88473. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:05.095013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for user cf6cc756845148ee8fce9021425cb7cb and project 4b181bc391914f6abcea09b894b88473. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:05.137509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:05.144387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:05.365991 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f64ce8af-c366-456c-93e8-8fad71755a2d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.237776 Jul 11 14:07:05.367284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 9/20] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:07:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 14:07:05.379963 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5a2ea5f8-7437-4c3f-8559-4308fc85cb67 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:05.380716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5a2ea5f8-7437-4c3f-8559-4308fc85cb67 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:05.732782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5a2ea5f8-7437-4c3f-8559-4308fc85cb67 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:05.761140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5a2ea5f8-7437-4c3f-8559-4308fc85cb67 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1222 microversion: 2.1 time: 0.387523 Jul 11 14:07:05.768732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 12/21] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:05 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1222 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:05.893591 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9e64b30d-2097-47a7-9769-4d995b33a415 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad67b40d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:05.952969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-9e64b30d-2097-47a7-9769-4d995b33a415 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] HTTP exception thrown: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9e64b30d-2097-47a7-9769-4d995b33a415 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Request method failure captured: Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 HTTP/1.1 Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC53bcbv5dZGBNohpmccKnIwkttx7npQBoA9M5bRRlzKdr6NQKU49DfFsYNa_kSpskChuMK83yRLvvWDNruRj23s1O_cRtTYEVI6DRsVgMD2XNkxCQGyx3SnPLCeJwtlLnza8evYJ6rM7qDTcy5qPuglgopD0dapwZDMnhTwFi0ypMw Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:07:05.957196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_15fd934ea11040fe93f64b06bb1e4e21", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}] Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 85a11b01e8dd4f1e9b83c9965853a99b Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '069b5729-6728-4428-a94e-4aa18df9de42'} Jul 11 14:07:05.958612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. (HTTP 404) (Request-ID: req-38d314ea-c77e-42fb-842d-f71dea236f5e) Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.959377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:07:05.960438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 11 14:07:05.961531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9e64b30d-2097-47a7-9769-4d995b33a415 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Returning 404 to user: Snapshot 069b5729-6728-4428-a94e-4aa18df9de42 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9e64b30d-2097-47a7-9769-4d995b33a415 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42" status: 404 len: 111 microversion: 2.1 time: 0.069052 Jul 11 14:07:05.969534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 13/22] 10.222.0.49 () {58 vars in 1250 bytes} [Mon Jul 11 14:07:05 2022] GET /compute/v2.1/os-snapshots/069b5729-6728-4428-a94e-4aa18df9de42 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:07:05.994000 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-18fbe8d4-82bd-4c21-bde4-ca4133aba762 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad7a3a9d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:06.090388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0cb215e2-a7a2-4031-8d01-d63630ab19e0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: .version_select at 0x7ffad5f00040>, body: {"keypair": {"name": "tempest-keypair-70371059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFN4pn5Kn8KuxHshGgsmcd4qUxsjU8BwkLD+5iTW0gKmAy1MFq85ymGdRV5VdRBRJ+qzUqBOPVxe7ZKL9cgkIzjH5HawUY8G70rn8Tzo9HFlJqzSs8WXSSBBuBQHcWjbQ=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:06.180480 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-0cb215e2-a7a2-4031-8d01-d63630ab19e0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for project a772cbaa461c416da2cc35e364541ecf. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:06.212597 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-0cb215e2-a7a2-4031-8d01-d63630ab19e0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for user 296853a88430438e96e0f8fb97b46d2e and project a772cbaa461c416da2cc35e364541ecf. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:06.233177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-18fbe8d4-82bd-4c21-bde4-ca4133aba762 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 202 len: 0 microversion: 2.1 time: 0.265447 Jul 11 14:07:06.233747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 14/23] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:07:05 2022] DELETE /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:07:06.242763 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1d7914f2-fce1-496e-bcf1-6cfe2267aaee tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad670b5e0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:06.401602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0cb215e2-a7a2-4031-8d01-d63630ab19e0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.826970 Jul 11 14:07:06.402672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 10/24] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:07:05 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:06.406425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1d7914f2-fce1-496e-bcf1-6cfe2267aaee tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 200 len: 344 microversion: 2.1 time: 0.167579 Jul 11 14:07:06.406997 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 15/25] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:07:06 2022] GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:07:06.426758 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1951014603", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:06.578245 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] validate_networks() for [('c944d348-d5b7-4b6c-9be2-cb2a59820444', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:07.420422 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b9dd3b5b-e83b-4c1a-8f47-e34d0dc96e92 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad670bca0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:07.490278 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-b9dd3b5b-e83b-4c1a-8f47-e34d0dc96e92 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] HTTP exception thrown: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b9dd3b5b-e83b-4c1a-8f47-e34d0dc96e92 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Request method failure captured: Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 HTTP/1.1 Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC53bcbv5dZGBNohpmccKnIwkttx7npQBoA9M5bRRlzKdr6NQKU49DfFsYNa_kSpskChuMK83yRLvvWDNruRj23s1O_cRtTYEVI6DRsVgMD2XNkxCQGyx3SnPLCeJwtlLnza8evYJ6rM7qDTcy5qPuglgopD0dapwZDMnhTwFi0ypMw Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:07:07.494977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_15fd934ea11040fe93f64b06bb1e4e21", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}] Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 85a11b01e8dd4f1e9b83c9965853a99b Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'bdac846e-ba25-4b1d-b1f7-d595a17f5188'} Jul 11 14:07:07.496003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. (HTTP 404) (Request-ID: req-e0241fb0-6cd7-4b37-aba0-353c16867b55) Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.496721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:07:07.497689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:07:07.498644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.499543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.504043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b9dd3b5b-e83b-4c1a-8f47-e34d0dc96e92 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Returning 404 to user: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:07:07.505152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b9dd3b5b-e83b-4c1a-8f47-e34d0dc96e92 tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 404 len: 109 microversion: 2.1 time: 0.088902 Jul 11 14:07:07.508311 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 16/26] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:07:07 2022] GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:07:07.525981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-54b6a773-5a72-4951-855a-4a025d738a1a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad670bd30>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:07.576124 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-54b6a773-5a72-4951-855a-4a025d738a1a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] HTTP exception thrown: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-54b6a773-5a72-4951-855a-4a025d738a1a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Request method failure captured: Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 HTTP/1.1 Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC53bcbv5dZGBNohpmccKnIwkttx7npQBoA9M5bRRlzKdr6NQKU49DfFsYNa_kSpskChuMK83yRLvvWDNruRj23s1O_cRtTYEVI6DRsVgMD2XNkxCQGyx3SnPLCeJwtlLnza8evYJ6rM7qDTcy5qPuglgopD0dapwZDMnhTwFi0ypMw Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:07:07.578610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_15fd934ea11040fe93f64b06bb1e4e21", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}] Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 85a11b01e8dd4f1e9b83c9965853a99b Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'bdac846e-ba25-4b1d-b1f7-d595a17f5188'} Jul 11 14:07:07.580208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. (HTTP 404) (Request-ID: req-17b62c4b-e26c-4735-bbf5-efdfe23b3b31) Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.580923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:07:07.581862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 14:07:07.585180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.586143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.589448 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-54b6a773-5a72-4951-855a-4a025d738a1a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Returning 404 to user: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:07:07.591084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-54b6a773-5a72-4951-855a-4a025d738a1a tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 404 len: 109 microversion: 2.1 time: 0.070216 Jul 11 14:07:07.598157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 17/27] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:07:07 2022] DELETE /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:07:07.606232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d9d53b7-b3fb-48e3-9914-9c344aa650bf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Calling method '.version_select at 0x7ffad67b4e50>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:07.661200 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-9d9d53b7-b3fb-48e3-9914-9c344aa650bf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] HTTP exception thrown: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d9d53b7-b3fb-48e3-9914-9c344aa650bf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Request method failure captured: Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 HTTP/1.1 Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC53bcbv5dZGBNohpmccKnIwkttx7npQBoA9M5bRRlzKdr6NQKU49DfFsYNa_kSpskChuMK83yRLvvWDNruRj23s1O_cRtTYEVI6DRsVgMD2XNkxCQGyx3SnPLCeJwtlLnza8evYJ6rM7qDTcy5qPuglgopD0dapwZDMnhTwFi0ypMw Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:07:07.663957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_15fd934ea11040fe93f64b06bb1e4e21", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/15fd934ea11040fe93f64b06bb1e4e21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/15fd934ea11040fe93f64b06bb1e4e21"}]}] Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 15fd934ea11040fe93f64b06bb1e4e21 Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-466432385 Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 85a11b01e8dd4f1e9b83c9965853a99b Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesSnapshotsTestJSON-466432385-project Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'bdac846e-ba25-4b1d-b1f7-d595a17f5188'} Jul 11 14:07:07.665012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. (HTTP 404) (Request-ID: req-e1f5eedc-af3c-4d84-b10e-987a32355ee5) Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.665640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:07:07.666564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:07:07.667461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. Jul 11 14:07:07.668320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:07:07.675088 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d9d53b7-b3fb-48e3-9914-9c344aa650bf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] Returning 404 to user: Volume bdac846e-ba25-4b1d-b1f7-d595a17f5188 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:07:07.676168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9d9d53b7-b3fb-48e3-9914-9c344aa650bf tempest-VolumesSnapshotsTestJSON-466432385 tempest-VolumesSnapshotsTestJSON-466432385-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188" status: 404 len: 109 microversion: 2.1 time: 0.073710 Jul 11 14:07:07.677490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 18/28] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:07:07 2022] GET /compute/v2.1/os-volumes/bdac846e-ba25-4b1d-b1f7-d595a17f5188 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:07:08.587841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:08.588661 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:08.589917 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:08.590851 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:08.592372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:08.615010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:08.615907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:08.620232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:08.621803 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:08.688878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for project 4b181bc391914f6abcea09b894b88473. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:08.701900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for user cf6cc756845148ee8fce9021425cb7cb and project 4b181bc391914f6abcea09b894b88473. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:08.738358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:08.741239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:08.814551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4992cb71-dfad-4971-b396-b360ed6c7426 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'create', calling method: .version_select at 0x7ffad67b4ee0>, body: {"keypair": {"name": "tempest-keypair-309688238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCMd2/vFkR1VvehcQvxtt1Jf2mCQt3TFTHWc88IlgTAQVjM9573tTbOboR8B94pHCFFxV2IW3hAg+v4es0jA8NZP8G+cMN7vLA6qMBNCB3ZGhMO7/pqe2ZkxkEMs+D7rg=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:08.879196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-4992cb71-dfad-4971-b396-b360ed6c7426 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for project beef80716d254a03a5e673b9cfd781ce. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:08.907323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-4992cb71-dfad-4971-b396-b360ed6c7426 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for user 98143abd2e3c47e3921184a1c5e05a89 and project beef80716d254a03a5e673b9cfd781ce. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:08.923753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-02e38465-74e3-4486-88d7-6b31cfc96eb7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.507062 Jul 11 14:07:08.932598 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 11/29] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:07:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:07:08.949437 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4d482978-0c77-4fd5-b997-a7c29f66faed tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:08.950514 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4d482978-0c77-4fd5-b997-a7c29f66faed tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:09.017240 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4992cb71-dfad-4971-b396-b360ed6c7426 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.773498 Jul 11 14:07:09.019460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 19/30] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 11 14:07:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 777 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 11 14:07:09.410620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4d482978-0c77-4fd5-b997-a7c29f66faed tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:09.491312 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4d482978-0c77-4fd5-b997-a7c29f66faed tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1222 microversion: 2.1 time: 0.557310 Jul 11 14:07:09.495316 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 12/31] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:08 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1222 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:09.876430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2015944093", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f652801d-32e3-4c8b-a676-9f89f4a15dcd"}], "security_groups": [{"name": "tempest-securitygroup--1948105867"}], "key_name": "tempest-keypair-401273566", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:10.342574 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1569271770", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "networks": [{"uuid": "b364de4d-87f1-4e0a-bd87-a6bc0f5965fd"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:10.655163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] validate_networks() for [('b364de4d-87f1-4e0a-bd87-a6bc0f5965fd', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:10.874508 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] validate_networks() for [('f652801d-32e3-4c8b-a676-9f89f4a15dcd', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:15.623295 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:15.624607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:15.625415 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:15.626153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:15.626861 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:15.653163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:15.655182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:15.661441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:15.663107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:15.767780 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Getting quotas for project 7136b6633c6e4d399a6d359d750125f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:15.799690 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Getting quotas for user 170f249dccd4498990a8344a18c73059 and project 7136b6633c6e4d399a6d359d750125f0. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:15.855257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:15.865040 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:15.912796 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:15.913769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:15.914079 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:15.914880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:15.915300 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:15.946335 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:15.946792 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:15.958027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:15.978410 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:16.056388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:16.069516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:16.091186 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:16.093771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:16.099488 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e6314f83-5133-4e02-8cb6-d8dcae76a662 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.364847 Jul 11 14:07:16.100842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 20/32] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 6367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:07:16.106533 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:16.109824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:16.127794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:16.128511 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:16.133773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:16.134567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:16.312800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-90c3ac5f-ec1c-43ac-baec-9bbbb408fa4a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.442733 Jul 11 14:07:16.326970 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 13/33] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:07:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 6458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 11 14:07:16.359668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3deabc52-0433-4aa6-b80d-04a2104648bb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:16.360972 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3deabc52-0433-4aa6-b80d-04a2104648bb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:17.077143 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3deabc52-0433-4aa6-b80d-04a2104648bb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:17.077143 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3deabc52-0433-4aa6-b80d-04a2104648bb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1215 microversion: 2.1 time: 0.741939 Jul 11 14:07:17.083474 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 14/34] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:16 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1215 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:17.090918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7744183d-b3fb-4dc8-a48d-7a224c34ef66 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:17.093565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7744183d-b3fb-4dc8-a48d-7a224c34ef66 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:17.114202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:17.176743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ec320592-2718-4916-afd8-85b421500fc8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1280 microversion: 2.1 time: 1.071611 Jul 11 14:07:17.177796 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 21/35] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:16 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1280 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:17.210195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-234410171", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a75a9f7a-5a4f-4c63-9c13-4bda5fe5b2fe"}], "security_groups": [{"name": "tempest-securitygroup--1068898992"}], "key_name": "tempest-keypair-309688238", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:17.408533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7744183d-b3fb-4dc8-a48d-7a224c34ef66 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:17.441841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7744183d-b3fb-4dc8-a48d-7a224c34ef66 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1241 microversion: 2.1 time: 0.351271 Jul 11 14:07:17.441841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 15/36] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:17 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1241 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:17.496018 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-863383461", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81252056-c78d-471a-b520-b6f6a1b0caa8"}], "security_groups": [{"name": "tempest-securitygroup--700278469"}], "key_name": "tempest-keypair-70371059", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:18.014226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] validate_networks() for [('a75a9f7a-5a4f-4c63-9c13-4bda5fe5b2fe', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:18.248551 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] validate_networks() for [('81252056-c78d-471a-b520-b6f6a1b0caa8', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:22.289191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:22.290258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:22.291153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:22.291826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:22.292704 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:22.339027 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:22.346685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:22.349120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:22.351365 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:22.429979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for project beef80716d254a03a5e673b9cfd781ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:22.441041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for user 98143abd2e3c47e3921184a1c5e05a89 and project beef80716d254a03a5e673b9cfd781ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:22.515608 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:22.524952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:22.543175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:22.543672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:22.545079 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:22.545780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:22.546621 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:22.605864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:22.606416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:22.611809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:22.615526 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:22.682057 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9c7119bc-4004-4969-b8af-693a7f61d0a1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.498100 Jul 11 14:07:22.684768 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 22/37] 10.222.0.49 () {62 vars in 1187 bytes} [Mon Jul 11 14:07:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 5506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 14:07:22.716887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:22.722233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:22.745426 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:22.746193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for project a772cbaa461c416da2cc35e364541ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:22.746931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:22.748206 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:22.748807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:22.767264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for user 296853a88430438e96e0f8fb97b46d2e and project a772cbaa461c416da2cc35e364541ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:22.817183 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:22.831253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:23.003409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-30a0200d-ebe2-45ab-9a52-e543549821be tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.511603 Jul 11 14:07:23.012937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 16/38] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:07:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 5517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:07:23.026123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:23.035838 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:23.045453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:23.064537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:23.065539 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:23.065953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:23.275395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:23.287716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-553a31e0-eba7-487f-bd0b-ab34ea9d3b59 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1273 microversion: 2.1 time: 0.601757 Jul 11 14:07:23.293800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 23/39] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:22 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1273 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:23.332708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:23.337534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:23.386142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:23.392633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:23.396098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:23.404076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:24.128981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:24.146562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e86925b9-9d42-4519-8498-d74235a75ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1299 microversion: 2.1 time: 0.830763 Jul 11 14:07:24.158612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 24/40] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:23 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1299 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:24.181846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:24.200554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:24.218952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:24.239210 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:24.244023 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:24.245288 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:24.742547 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:24.747813 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:24.762850 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:24.767233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:24.772589 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c821430b-0c03-40e3-909d-fa388897fe3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 1.761947 Jul 11 14:07:24.782651 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 17/41] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:23 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:24.791544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-14fefb4b-d8bf-44b3-be62-a086fcd8ad79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1276 microversion: 2.20 time: 0.630082 Jul 11 14:07:24.795289 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 25/42] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:24 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1276 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:24.803018 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:24.803873 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:24.810345 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:24.811096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:24.827143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:24.828992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:24.833452 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:24.839734 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:24.840596 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:24.841047 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:24.842838 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:24.845188 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:25.031956 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:25.067138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9f098d63-399e-44c8-8e7a-03a57e08d97f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1273 microversion: 2.1 time: 0.268805 Jul 11 14:07:25.071327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 26/43] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:24 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:25.177706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:25.178462 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:25.187001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:25.194485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:25.195349 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:25.203058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:25.628957 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:25.644969 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2921092d-2e43-448a-ad5a-52fe12236a1c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1231 microversion: 2.1 time: 0.853509 Jul 11 14:07:25.650368 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 18/44] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:24 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1231 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:25.797601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:25.799459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:25.816191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:25.817279 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:25.846291 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:25.848417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:26.284456 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:26.305500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5368116a-971c-410a-a210-3574e28a4973 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 1.132537 Jul 11 14:07:26.316233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 27/45] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:25 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:26.324876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:26.325886 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:26.339478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:26.340208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:26.341307 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:26.342274 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:27.792930 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:27.832653 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:27.834453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:27.837137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e03ae934-373c-4c14-a7a7-6521724074d0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1340 microversion: 2.20 time: 1.523728 Jul 11 14:07:27.838742 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 28/46] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:26 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1340 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:27.870453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:27.885836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-12c2ec40-e7e2-4e5b-90bd-d7d427783951 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 2.089806 Jul 11 14:07:27.899869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 19/47] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:25 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:27.916492 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:27.918368 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:27.927690 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:27.946870 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:27.947871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:27.949292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:27.951196 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.229949 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b6e7caac-4425-418e-9b2a-180976c564b3 req-4a830d4a-f29c-4319-9d92-953979e5890b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d8c2737-675e-4124-86c5-2c06d1d65991", "tag": "e0ad0377-4158-40bf-b3a5-efaddf7e18fe"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:28.272485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b6e7caac-4425-418e-9b2a-180976c564b3 req-4a830d4a-f29c-4319-9d92-953979e5890b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.273142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b6e7caac-4425-418e-9b2a-180976c564b3 req-4a830d4a-f29c-4319-9d92-953979e5890b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.324034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b6e7caac-4425-418e-9b2a-180976c564b3 req-4a830d4a-f29c-4319-9d92-953979e5890b service nova] Creating event network-changed:e0ad0377-4158-40bf-b3a5-efaddf7e18fe for instance 7d8c2737-675e-4124-86c5-2c06d1d65991 on hv-cinder-84842 Jul 11 14:07:28.324822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b6e7caac-4425-418e-9b2a-180976c564b3 req-4a830d4a-f29c-4319-9d92-953979e5890b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117981) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 14:07:28.326641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.327285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.328950 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.329590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.340309 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.compute.rpcapi [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 14:07:28.341525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] Releasing lock "compute-rpcapi-router" {{(pid=117981) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 14:07:28.363959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-38bbd7cc-749d-4568-97b9-95535998530a None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.523550 Jul 11 14:07:28.365459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 29/48] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:28.371590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.373136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:28.384451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.385292 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.387015 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.389144 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.631040 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:28.643438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a47ad8f8-55c5-4930-861b-2c7c0a07c1c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1293 microversion: 2.1 time: 0.276360 Jul 11 14:07:28.649380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 30/49] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:28 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1293 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:28.669826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:28.670568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:28.712562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.712562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.718628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:28.719301 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:28.833625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:28.837126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=31 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:28.845086 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-532a2f60-2893-4e6a-adc1-14eaf60480c6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.940024 Jul 11 14:07:28.846884 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 20/50] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:27 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:29.058099 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-368e9d8d-2ae1-4892-a123-c9867fe88fe1 req-f3db42f1-478b-4e2f-8310-09c093968a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246af345-cb1b-449d-abe1-4be428cb9ee3", "tag": "9e9fda17-8838-4876-b6ae-3c59dd83071a"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:29.063463 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:29.073281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4b356920-3f9b-46db-affb-b56a3ea0b0c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.422556 Jul 11 14:07:29.073665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-368e9d8d-2ae1-4892-a123-c9867fe88fe1 req-f3db42f1-478b-4e2f-8310-09c093968a9b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.074395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-368e9d8d-2ae1-4892-a123-c9867fe88fe1 req-f3db42f1-478b-4e2f-8310-09c093968a9b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.079064 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 31/51] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:28 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:29.084164 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:29.086507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:29.101498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.102346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.105344 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.105986 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.110400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-368e9d8d-2ae1-4892-a123-c9867fe88fe1 req-f3db42f1-478b-4e2f-8310-09c093968a9b service nova] Creating event network-changed:9e9fda17-8838-4876-b6ae-3c59dd83071a for instance 246af345-cb1b-449d-abe1-4be428cb9ee3 on hv-cinder-84842 Jul 11 14:07:29.111107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-368e9d8d-2ae1-4892-a123-c9867fe88fe1 req-f3db42f1-478b-4e2f-8310-09c093968a9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 11 14:07:29.115069 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.120272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.121414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.121966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.142096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=9 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:29.148578 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.compute.rpcapi [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 11 14:07:29.155664 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] Releasing lock "compute-rpcapi-router" {{(pid=117980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 11 14:07:29.178444 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-eb422f04-c93a-4a0d-9f77-0192866e5917 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329507 Jul 11 14:07:29.179643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 21/52] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:29.204399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:29.206918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:29.222606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.224537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.228531 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.229666 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.245151 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:29.276372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:29.295054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:29.297757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c5c10c5f-02ba-4a86-8feb-97fa53b62e5c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1338 microversion: 2.20 time: 0.216805 Jul 11 14:07:29.302812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 32/53] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:29 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1338 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:29.565509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:29.596675 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-142377e8-1676-4637-a6d4-fd76bf0e9b90 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.414710 Jul 11 14:07:29.601403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 22/54] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:29 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:29.666926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:29.668081 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:29.692671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.695069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.696660 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.701522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.863271 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:29.863888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:29.873071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.873536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:29.874370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:29.876479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:30.406170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:30.417061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fb38cb16-277f-4649-bd61-78cbc5b95d5d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1293 microversion: 2.1 time: 0.757019 Jul 11 14:07:30.418176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 33/55] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:29 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1293 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:30.425407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:30.426374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:30.435802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:30.436571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:30.437879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:30.438575 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:30.943325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:30.953273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6f21defa-0347-4a41-81c5-e0224fd8c591 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 1.093982 Jul 11 14:07:30.962547 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 23/56] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:29 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:30.966929 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:30.967555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:30.991549 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:31.015273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.019060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.021476 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-464454a5-5906-41d1-9e07-f4e32b891009 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.600880 Jul 11 14:07:31.022937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.025361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 34/57] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:30 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:31.035535 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.067528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:31.076266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:31.099547 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.100005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.100789 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.101225 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.246824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:31.257163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:31.258731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:31.259848 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1fb43a66-a873-4797-a9e2-d952bc006319 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1338 microversion: 2.20 time: 0.301630 Jul 11 14:07:31.263248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 24/58] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:30 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1338 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:31.280159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-6e02f105-a917-4a72-9f33-6d4ef53df695 req-28b77b21-73fd-4aad-a053-ee9098cb5817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bf941c-f166-4236-b1dc-c7943dfa23cb", "tag": "60d6a63c-f969-420e-97a5-2a6fcfdfeaa4"}, {"name": "network-changed", "server_uuid": "79ee777f-fba0-48b0-895e-8f63700a5677", "tag": "7e6fb041-72fb-48ee-8444-5e1261b51dfd"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:31.302549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6e02f105-a917-4a72-9f33-6d4ef53df695 req-28b77b21-73fd-4aad-a053-ee9098cb5817 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.303002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6e02f105-a917-4a72-9f33-6d4ef53df695 req-28b77b21-73fd-4aad-a053-ee9098cb5817 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.332672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-6e02f105-a917-4a72-9f33-6d4ef53df695 req-28b77b21-73fd-4aad-a053-ee9098cb5817 service nova] Creating event network-changed:60d6a63c-f969-420e-97a5-2a6fcfdfeaa4 for instance b2bf941c-f166-4236-b1dc-c7943dfa23cb on hv-cinder-84842 Jul 11 14:07:31.333193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-6e02f105-a917-4a72-9f33-6d4ef53df695 req-28b77b21-73fd-4aad-a053-ee9098cb5817 service nova] Creating event network-changed:7e6fb041-72fb-48ee-8444-5e1261b51dfd for instance 79ee777f-fba0-48b0-895e-8f63700a5677 on hv-cinder-84842 Jul 11 14:07:31.350514 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-6e02f105-a917-4a72-9f33-6d4ef53df695 req-28b77b21-73fd-4aad-a053-ee9098cb5817 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077310 Jul 11 14:07:31.351176 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 25/59] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:31.434953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:31.435804 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:31.450386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.450919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.451614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.452054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.809268 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:31.831303 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-17234736-f395-469d-add1-af3aeae4a477 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.792803 Jul 11 14:07:31.832293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 35/60] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:31 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:31.860022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:31.869913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bf483a6a-80e8-46ce-a111-82b17f968904 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.438325 Jul 11 14:07:31.879540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 26/61] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:31 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:31.970696 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:31.971180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:31.974028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:31.985374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.986052 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:31.987094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:31.988860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.043317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:32.044003 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:32.056601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.057501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.058741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.061338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.263679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:32.267562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:32.274294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2422908e-9da9-445d-a71f-10bfc7287e2a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.235324 Jul 11 14:07:32.284001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-08d4ac4c-8036-4fea-a133-4a94038fbe27 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.309271 Jul 11 14:07:32.284001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 36/62] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:31 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:32.285240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 27/63] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:32 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:32.291024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:32.292069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:32.301046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.301664 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.302881 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.303425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.487034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:32.501372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:32.504171 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:32.506348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-291d3b6c-7ca8-4320-b3fe-9f68815f01d4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.227012 Jul 11 14:07:32.507151 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 37/64] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:32 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:32.850050 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:32.850701 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:32.853801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=34 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:32.862578 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.863184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.863845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.864287 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.896274 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:32.897425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:32.904707 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=22 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:32.910761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.911604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.912983 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:32.913629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:32.920448 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:33.322814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:33.352661 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0d4f951a-c3d7-4b1c-8438-371a5e6b6e60 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.506867 Jul 11 14:07:33.353429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 28/65] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:32 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:33.363398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:33.364318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:33.372367 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:33.373291 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:33.374455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:33.374583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:33.375622 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:33.385550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3c799c5b-1a9f-439d-8a96-314c13144e8f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.494190 Jul 11 14:07:33.386126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 38/66] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:32 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:33.399365 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:33.400159 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:33.425887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:33.428568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:33.429571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:33.431033 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:33.806139 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:33.814224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-54c86e0e-bf7e-4dfa-9e67-c124eaf2007b tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.421693 Jul 11 14:07:33.815165 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 39/67] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:33 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:33.823913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:33.831074 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:33.841114 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:33.841230 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:33.845191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:33.845627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:33.930294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:33.946279 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dee40ad7-f6e8-48be-99b4-883756022a7d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.591454 Jul 11 14:07:33.949411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 29/68] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:33 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:34.180446 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:34.215986 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:34.219798 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:34.221114 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9f758b78-ba15-4aba-bc24-371a4c3825f1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.405009 Jul 11 14:07:34.232984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 40/69] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:33 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:34.371098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:34.371710 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:34.388496 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:34.389281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:34.394290 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:34.403513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:34.404129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:34.413676 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:34.418946 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:34.426243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:34.428175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:34.428833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:34.989951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:34.993366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:34.998713 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-792a8aad-4e9b-450c-ae64-5e8fa42301ff tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.599392 Jul 11 14:07:34.999645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 41/70] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:34 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:35.001978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-29ad6092-e3b2-48fa-aff3-1973a1c3cfd2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.636180 Jul 11 14:07:35.002579 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 30/71] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:34 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:35.006080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-0538c361-dfa2-432f-9dfc-51d841b204ba req-19aa75e5-0256-4165-b91b-a69afc88b973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c538a6-c82b-4cc8-be39-aecd9c223140", "tag": "57d96d85-ab17-428a-92d7-20cf06bf4d35"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:35.029102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:35.029726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:35.030931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-0538c361-dfa2-432f-9dfc-51d841b204ba req-19aa75e5-0256-4165-b91b-a69afc88b973 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.032326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-0538c361-dfa2-432f-9dfc-51d841b204ba req-19aa75e5-0256-4165-b91b-a69afc88b973 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.042397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.042855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.043638 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.044071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.055885 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-0538c361-dfa2-432f-9dfc-51d841b204ba req-19aa75e5-0256-4165-b91b-a69afc88b973 service nova] Creating event network-changed:57d96d85-ab17-428a-92d7-20cf06bf4d35 for instance e4c538a6-c82b-4cc8-be39-aecd9c223140 on hv-cinder-84842 Jul 11 14:07:35.061609 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-0538c361-dfa2-432f-9dfc-51d841b204ba req-19aa75e5-0256-4165-b91b-a69afc88b973 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059913 Jul 11 14:07:35.063035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 42/72] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:35.076584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:35.077721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:35.091666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.095841 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.096762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.099993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.337984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:35.351637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-326b3295-b7c2-4ba8-a950-f46f221d97da tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.286210 Jul 11 14:07:35.352237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 43/73] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:35 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:35.364483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:35.364787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-45ce526d-3b39-472e-b664-ece6b0a313e4 req-f32e5599-47c9-4b3e-805c-627dc344e5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:35.373010 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-45ce526d-3b39-472e-b664-ece6b0a313e4 req-f32e5599-47c9-4b3e-805c-627dc344e5f2 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.373679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-45ce526d-3b39-472e-b664-ece6b0a313e4 req-f32e5599-47c9-4b3e-805c-627dc344e5f2 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.375743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c5830c50-0fe0-475a-abcf-5d97d857c42e tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.371791 Jul 11 14:07:35.377728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 31/74] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:35 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:35.396516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-45ce526d-3b39-472e-b664-ece6b0a313e4 req-f32e5599-47c9-4b3e-805c-627dc344e5f2 service nova] Creating event network-changed:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:07:35.402110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-45ce526d-3b39-472e-b664-ece6b0a313e4 req-f32e5599-47c9-4b3e-805c-627dc344e5f2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048527 Jul 11 14:07:35.402850 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:35.407370 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 44/75] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:35.408400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:35.423883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.424558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.425493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:35.426741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:35.719771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:35.729627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:35.731332 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:35.732534 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-adbd2d1d-2772-4ccf-aa43-8afcde4e7d95 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.353567 Jul 11 14:07:35.745247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 32/76] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:35 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:36.018193 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:36.018857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:36.029461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:36.030826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:36.032455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:36.033655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:36.059837 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:36.063043 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:36.081314 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:36.082013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:36.082990 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:36.083461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:36.956927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:36.965057 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d516e9c7-9d34-4af8-bc9a-586366bb8d11 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.942497 Jul 11 14:07:36.978990 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:36.992016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f62b3d85-bddf-42f6-8ecc-1619f79da2ee tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.979086 Jul 11 14:07:36.992219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 33/77] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:36 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:36.993334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 45/78] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:36 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:37.005173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:37.006026 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:37.011354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:37.014346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:37.018178 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.019016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.020471 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.021058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.034250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.035633 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.051092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.055777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.336498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:37.350395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-43269a90-6787-4947-98c3-7dd2a9e1c749 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.355751 Jul 11 14:07:37.351042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 46/79] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:36 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:37.373347 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:37.381581 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2ecf0ae4-7c95-42a0-b25c-9bfcc4bac8f9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.387824 Jul 11 14:07:37.382041 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 34/80] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:36 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:37.387059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:37.387796 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:37.393845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.394427 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.395320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.395904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.575350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:37.585558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:37.587598 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:37.589132 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e81a0450-8e1e-4f12-a6f8-824dcf0c8564 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.205814 Jul 11 14:07:37.589828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 35/81] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:37 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:37.669913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-9a2eaa08-1980-4c86-b0b5-46126e1203e6 req-4903d7ea-f227-4bf2-9622-234f17115744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d8c2737-675e-4124-86c5-2c06d1d65991", "name": "network-vif-plugged", "status": "completed", "tag": "e0ad0377-4158-40bf-b3a5-efaddf7e18fe"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:37.687694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-9a2eaa08-1980-4c86-b0b5-46126e1203e6 req-4903d7ea-f227-4bf2-9622-234f17115744 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:37.688169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-9a2eaa08-1980-4c86-b0b5-46126e1203e6 req-4903d7ea-f227-4bf2-9622-234f17115744 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:37.702173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-9a2eaa08-1980-4c86-b0b5-46126e1203e6 req-4903d7ea-f227-4bf2-9622-234f17115744 service nova] Creating event network-vif-plugged:e0ad0377-4158-40bf-b3a5-efaddf7e18fe for instance 7d8c2737-675e-4124-86c5-2c06d1d65991 on hv-cinder-84842 Jul 11 14:07:37.709368 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-9a2eaa08-1980-4c86-b0b5-46126e1203e6 req-4903d7ea-f227-4bf2-9622-234f17115744 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356736 Jul 11 14:07:37.710747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 47/82] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:37.988350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:37.990398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:38.003527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.014640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.016748 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.017097 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:38.019359 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:38.020491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.039962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.041233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.042954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.044180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.329511 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.339545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:38.340681 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-91a83dc1-043c-4c3c-b045-6ef711cdef86 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.360549 Jul 11 14:07:38.342996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 36/83] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:37 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:38.373331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:38.373459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:38.379632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.380085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.380860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.386564 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.446892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.458961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-87e25d5c-a27d-4131-887d-8a1b4562e4f4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.452244 Jul 11 14:07:38.469398 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 48/84] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:38 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:38.475531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:38.476300 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:38.500729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.501162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.501960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.502446 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.710522 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.719312 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0942d8a0-31e7-4b27-b3cb-933b75a58403 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.351673 Jul 11 14:07:38.721978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 37/85] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:38 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:38.747243 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:38.747977 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:38.765030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.767399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.768226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:38.768668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:38.777543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.786872 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f6042a0d-d0f1-4796-b6b0-220803375553 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.315389 Jul 11 14:07:38.787794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 49/86] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:38 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:38.790789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:38.936152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.945239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.948037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:38.949374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-63d993b8-a48c-40f3-be87-dbd63b699c62 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.215707 Jul 11 14:07:38.949935 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 38/87] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:38 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:39.357965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:39.358605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:39.366264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.366796 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.367576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.368013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.477682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:39.479038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:39.484622 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:39.486387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.486788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.487698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.488292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.522866 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:39.533046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f492e428-2d01-466e-bdc5-2841789805b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.178806 Jul 11 14:07:39.534567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 50/88] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:39 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:39.653245 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:39.660888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a8fd4355-cef8-44c1-b7d7-84d38ecb66ad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.188005 Jul 11 14:07:39.670858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 39/89] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:39 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:39.738998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:39.740012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:39.746142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.746953 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.748037 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.748681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.807247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:39.808160 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:39.825894 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.827159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.829632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.831015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.930441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:39.940519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d99060c8-3ec8-419f-b7a6-513be0266751 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.205786 Jul 11 14:07:39.945181 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 51/90] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:39 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:39.968995 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:39.969816 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:39.978687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.979160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:39.979924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:39.980360 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.058711 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:40.075031 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-eee92247-0a0a-4b49-95bd-797ae894f288 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.269854 Jul 11 14:07:40.080789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 40/91] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:39 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:40.177837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:40.186495 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:40.188120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:40.190143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9208e3ae-5ae4-4817-bee7-22970120bbb1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.224774 Jul 11 14:07:40.191107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 52/92] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:39 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:07:40.551306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:40.553248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:40.559883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.560695 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.561628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.562796 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.597920 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-5b147dc8-c098-4d47-8d53-6ce86b3b784c req-9f8e3c1d-1ae4-4ca5-b856-1157734553e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246af345-cb1b-449d-abe1-4be428cb9ee3", "name": "network-vif-plugged", "status": "completed", "tag": "9e9fda17-8838-4876-b6ae-3c59dd83071a"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:40.614996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5b147dc8-c098-4d47-8d53-6ce86b3b784c req-9f8e3c1d-1ae4-4ca5-b856-1157734553e3 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.617130 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5b147dc8-c098-4d47-8d53-6ce86b3b784c req-9f8e3c1d-1ae4-4ca5-b856-1157734553e3 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.641944 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-5b147dc8-c098-4d47-8d53-6ce86b3b784c req-9f8e3c1d-1ae4-4ca5-b856-1157734553e3 service nova] Creating event network-vif-plugged:9e9fda17-8838-4876-b6ae-3c59dd83071a for instance 246af345-cb1b-449d-abe1-4be428cb9ee3 on hv-cinder-84842 Jul 11 14:07:40.660716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-5b147dc8-c098-4d47-8d53-6ce86b3b784c req-9f8e3c1d-1ae4-4ca5-b856-1157734553e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067018 Jul 11 14:07:40.661502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 53/93] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:07:40.677981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:40.678721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:40.685590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.687917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.689391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.690156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.759668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:40.776055 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dfb0fb01-fec4-4797-b955-049ab184e052 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.225967 Jul 11 14:07:40.777984 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 41/94] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:40 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:40.896302 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:40.905745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2d14a93f-f213-404f-9f21-7b7ad49b5e0a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.232127 Jul 11 14:07:40.907400 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 54/95] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:40 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:40.962458 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:40.963288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:40.970125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.970829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:40.971796 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:40.972576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.093819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:41.094596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:41.101507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.105645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.107257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.110175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.145227 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:41.160766 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0ab3a541-8810-4d2e-b2aa-3987d30aa9c7 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.201657 Jul 11 14:07:41.163336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 42/96] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:40 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:41.209338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:41.210350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:41.217574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.218204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.219404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.220310 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.344048 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:41.351811 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-75bcced2-04c2-4cb7-9673-62fad871b71f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.261873 Jul 11 14:07:41.352960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 55/97] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:41 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:41.406517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:41.432189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:41.433947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:41.435848 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9d591f82-0d28-4bcb-b572-8111eb3f61d8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.230849 Jul 11 14:07:41.436737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 43/98] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:41 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:07:41.797520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:41.798502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:41.806801 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.807605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.809191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.810567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.925232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:41.925978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:41.932941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.934197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:41.935284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:41.935932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.126512 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.135761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b1e0430c-ca28-4358-82aa-8301bdf4d92b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.343341 Jul 11 14:07:42.147577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 56/99] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:41 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:42.180017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.183736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:42.184961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:42.193757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:42.194996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-807588f9-d641-46cf-a6cf-2a64a16bfe6c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.274683 Jul 11 14:07:42.196090 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 44/100] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:41 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:42.202612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.204915 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:42.206098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.227108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:42.370011 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:42.370841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:42.378391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:42.378977 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.379965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:42.380588 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.410337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.421207 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fea5b2db-b460-411f-8363-6a94e5cb4449 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.247334 Jul 11 14:07:42.422849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 57/101] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:42 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:42.454947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:42.455563 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:42.461701 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:42.462221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.462951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:42.463379 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:42.585359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.594021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a778e433-f0d2-4d29-beca-2ca8b3dec06c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.228474 Jul 11 14:07:42.603712 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 45/102] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:42 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:42.893850 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.902234 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.903911 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:42.905804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4093eed9-76d2-48a0-ac0d-cf32f75c8b4e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.454925 Jul 11 14:07:42.907162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 58/103] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:42 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:07:43.157196 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:43.158560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:43.167334 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.168583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.169515 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.170514 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.213198 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:43.213976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:43.220444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.221060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.222137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.222659 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.409045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:43.420622 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-40c8b87f-4824-4eee-9dd4-74cba4cda13f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.269099 Jul 11 14:07:43.421397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 46/104] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:43 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:43.439136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:43.439753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:43.446056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.446544 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.447330 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.447769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.542911 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:43.555646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-915e655d-14d9-4fbc-9880-322fd5563587 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.346530 Jul 11 14:07:43.566981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 59/105] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:43 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:43.612848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:43.614068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:43.621732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.622486 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.623468 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.624358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.649022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:43.659596 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7a9eb179-725f-43cc-89fa-552847c172e2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.224230 Jul 11 14:07:43.660197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 47/106] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:43 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:43.762129 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-532196d5-a974-488e-a6f6-db77dca71399 req-e20b8567-e2cc-4b75-ada9-02b75f1cfba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bf941c-f166-4236-b1dc-c7943dfa23cb", "name": "network-vif-plugged", "status": "completed", "tag": "60d6a63c-f969-420e-97a5-2a6fcfdfeaa4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:43.777575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-532196d5-a974-488e-a6f6-db77dca71399 req-e20b8567-e2cc-4b75-ada9-02b75f1cfba7 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.778027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-532196d5-a974-488e-a6f6-db77dca71399 req-e20b8567-e2cc-4b75-ada9-02b75f1cfba7 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.810056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-532196d5-a974-488e-a6f6-db77dca71399 req-e20b8567-e2cc-4b75-ada9-02b75f1cfba7 service nova] Creating event network-vif-plugged:60d6a63c-f969-420e-97a5-2a6fcfdfeaa4 for instance b2bf941c-f166-4236-b1dc-c7943dfa23cb on hv-cinder-84842 Jul 11 14:07:43.817572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-532196d5-a974-488e-a6f6-db77dca71399 req-e20b8567-e2cc-4b75-ada9-02b75f1cfba7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058645 Jul 11 14:07:43.818688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 48/107] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:07:43.822578 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:43.832376 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-78060a2e-c825-4e8c-8aad-809ee5c54a35 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.225006 Jul 11 14:07:43.832984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 60/108] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:43 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:43.925097 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:43.925973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:43.933472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.934019 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:43.935141 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:43.935614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.088253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:44.099701 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:44.101308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:44.102795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-37e927c9-5bb5-42c5-a15f-b1d17083f52b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.183201 Jul 11 14:07:44.103353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 49/109] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:43 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:44.438405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:44.439588 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:44.447266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.448008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.449457 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.450352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.574352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:44.575051 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:44.586142 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.586689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.587624 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.589835 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.627217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:44.638771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0ad8ac9b-8f67-4c15-b1f6-c5b13a7ebeaf tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.203749 Jul 11 14:07:44.641005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 61/110] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:44 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:44.675804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:44.676426 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:44.687840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.688294 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.690728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.691195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.831350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:44.839118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-67c93748-a17f-40d7-a6ce-5c1c87b3f1d0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.268909 Jul 11 14:07:44.839814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 50/111] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:44 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:44.852287 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:44.853117 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:44.860649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.861690 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.862819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:44.863468 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:44.904280 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:44.914249 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dfc1ea25-ec0b-4b50-b8f4-4c2db2d6d071 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.241698 Jul 11 14:07:44.915638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 62/112] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:44 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:45.021917 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:45.029974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c1cedf59-0bfd-461c-b839-47f01eacf515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.182508 Jul 11 14:07:45.040777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 51/113] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:44 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:45.120926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:45.121541 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:45.127613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.128069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.128841 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.129281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.281686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:45.289931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:45.291586 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:45.292778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c803e67c-24a7-4c3a-a6bf-b666f6c17791 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.175714 Jul 11 14:07:45.293502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 63/114] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:45 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:07:45.657890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:45.659144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:45.669579 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.670225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.671410 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.672191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.824876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:45.833197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b035fbcd-8b62-4d9d-872c-690835f622c7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.180362 Jul 11 14:07:45.833765 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 52/115] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:45 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:45.857530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:45.858093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:45.864681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.865126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.866001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.866469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.932462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:45.933048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:45.939811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.940264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:45.941033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:45.941465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:46.112645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:46.120143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5f3e6f96-8a2e-4ef8-ba4c-e4decb2c5384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.267246 Jul 11 14:07:46.120710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 64/116] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:45 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:46.133806 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:46.134435 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:46.141226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:46.141673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:46.142649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:46.143106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:46.173623 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:46.182487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9787feaf-c03b-4fa9-8108-0fb78e3733eb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.253781 Jul 11 14:07:46.183397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 53/117] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:45 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:46.294938 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:46.302845 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3df1dff0-1013-4cf2-8f54-87f876fdc1f1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.172681 Jul 11 14:07:46.303493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 65/118] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:46 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:46.312574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:46.313368 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:46.320868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:46.321446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:46.322225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:46.322722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:46.476977 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:46.486430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:46.488260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:46.489378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-85ef7ecf-0745-4a0a-bdd1-60ad547827c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.181713 Jul 11 14:07:46.489936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 54/119] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:46 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:46.850352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:46.851207 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:46.858652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:46.867977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:46.867977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:46.867977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.019695 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.044706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f966d45b-f90a-4972-8c1b-c79b846df253 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.198542 Jul 11 14:07:47.055812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 66/120] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:46 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:47.139185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:47.139812 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:47.146459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.146916 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.147699 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.148125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.206576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:47.207545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:47.219737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.220700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.223171 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.224103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.339416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.342429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:47.350472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7778868b-b664-4fa0-b3af-7c30ff7b02ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.218077 Jul 11 14:07:47.351397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 55/121] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:47 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:47.356084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:47.356918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:47.363106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.363971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.364946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.365544 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.470833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.480059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f2353330-c6b8-46ad-af0e-a52bc5217b36 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.278815 Jul 11 14:07:47.496408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 67/122] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:47 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:47.509833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:47.512080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:47.522401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.523218 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.524319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:47.524944 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:47.552409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.561288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-eb60dca6-3d09-4b84-8e39-fcd9aaa297b1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.208560 Jul 11 14:07:47.562722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 56/123] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:47 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:47.708674 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.723952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.728460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:47.730167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a8b50a91-1aa4-406f-8620-9699a02ad44e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.226164 Jul 11 14:07:47.732117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 68/124] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:47 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:48.063127 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:48.063737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:48.069729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.070173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.070986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.071415 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.215311 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:48.225028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-39dee365-8e5e-4172-8434-b9b29c196983 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.166451 Jul 11 14:07:48.230812 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 57/125] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:48 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:48.367863 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:48.369306 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:48.376334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.376942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.377808 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.378389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.505197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:48.505927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:48.524008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.525736 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.527961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.530974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.569688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:48.578692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d45f634e-2311-46d7-9c91-f04e24f54276 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.214538 Jul 11 14:07:48.585110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 69/126] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:48 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:48.594211 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:48.595234 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:48.613009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.613501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.614346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.614763 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.783286 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:48.808980 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d2c85d13-8e89-4412-8ca9-9ce2f2dcd9cb tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.307854 Jul 11 14:07:48.810788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 58/127] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:48 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:48.819828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-0b8c88ac-7060-47b4-afe3-19ecba90c725 req-43bcb9aa-4d70-40fa-a09e-85ccc85f17c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ee777f-fba0-48b0-895e-8f63700a5677", "name": "network-vif-plugged", "status": "completed", "tag": "7e6fb041-72fb-48ee-8444-5e1261b51dfd"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:48.829385 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:48.834480 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-0b8c88ac-7060-47b4-afe3-19ecba90c725 req-43bcb9aa-4d70-40fa-a09e-85ccc85f17c1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.835092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-0b8c88ac-7060-47b4-afe3-19ecba90c725 req-43bcb9aa-4d70-40fa-a09e-85ccc85f17c1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.836416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c5697015-0f51-43fa-9539-dcbe1f0fbd05 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.249848 Jul 11 14:07:48.837075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 70/128] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:48 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:48.846378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:48.847282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:48.852195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-0b8c88ac-7060-47b4-afe3-19ecba90c725 req-43bcb9aa-4d70-40fa-a09e-85ccc85f17c1 service nova] Creating event network-vif-plugged:7e6fb041-72fb-48ee-8444-5e1261b51dfd for instance 79ee777f-fba0-48b0-895e-8f63700a5677 on hv-cinder-84842 Jul 11 14:07:48.854405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.854929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.855919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:48.856529 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:48.858242 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-0b8c88ac-7060-47b4-afe3-19ecba90c725 req-43bcb9aa-4d70-40fa-a09e-85ccc85f17c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045950 Jul 11 14:07:48.858992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 59/129] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:49.011390 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:49.020003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:49.021826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:49.022965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a4eb186e-4e51-47f6-8ee2-cdec9f6b6acd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.184230 Jul 11 14:07:49.023523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 71/130] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:48 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:49.247238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:49.247814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:49.254694 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.255136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.255914 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.256340 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.419178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:49.427060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-891ad8f8-592a-4a91-9fbf-773bd9171239 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.183752 Jul 11 14:07:49.427953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 60/131] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:49 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:49.601592 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:49.602231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:49.608827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.609019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.609701 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.610138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.751096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:49.759218 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ecc6a810-2676-47bd-a21a-713cdec47c82 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.161484 Jul 11 14:07:49.759801 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 72/132] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:49 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:49.832162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:49.833544 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:49.849142 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.849930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.855296 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:49.856711 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.857135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.860609 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:49.879093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.879613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:49.880453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:49.880885 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:50.190553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:50.191197 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:50.200027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1816010a-9f29-4be4-9fb9-6b72730e2844 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.371850 Jul 11 14:07:50.200625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 61/133] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:49 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:50.205624 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:50.206597 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:50.209319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b9f1c268-97fa-4021-8da7-4b11193ddd2c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.357975 Jul 11 14:07:50.210493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 73/134] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:49 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:50.219524 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:50.220112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:50.221031 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:50.221717 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:50.410200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:50.421089 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:50.424354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:50.432192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4b746f10-703c-4769-a907-bb10d12610f8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.224455 Jul 11 14:07:50.432192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 62/135] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:50 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:50.446894 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:50.448022 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:50.456844 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:50.457529 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:50.458440 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:50.459085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:50.463550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:50.605863 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:50.617685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3580fdfc-392a-46de-a29f-3c406b8477ab tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1322 microversion: 2.1 time: 0.177005 Jul 11 14:07:50.618605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 74/136] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:50 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:50.790246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:50.790902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:50.799880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:50.801105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:50.803121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:50.804045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.011610 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.021799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0d5fe313-201c-4d86-ad84-a47e8f209c57 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.239369 Jul 11 14:07:51.023301 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 63/137] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:50 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:51.216904 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:51.217515 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:51.225014 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.225443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.226405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.226986 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.228239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:51.229494 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:51.239694 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.240432 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.241649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.242077 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.459520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.473147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3e0c76e3-ab1a-43e9-9297-450717f178b3 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.259961 Jul 11 14:07:51.473333 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.481976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-580aba30-f91a-415c-8f4c-39b5d5698039 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.258589 Jul 11 14:07:51.482958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 64/138] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:51 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:51.486015 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 75/139] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:51 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:51.488859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:51.489654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:51.497162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.497869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.498901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.499987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.638757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:51.640807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:51.647220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.648296 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.649359 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.650459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.666930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.678995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.680204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.681328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-347848b9-bb43-4ef8-bffd-f08c0cf248f2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.197049 Jul 11 14:07:51.681882 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 65/140] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:51 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:51.823693 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:51.833766 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4fc2eddc-815c-46c6-823c-35a588a9ad3d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1516 microversion: 2.1 time: 0.202032 Jul 11 14:07:51.838985 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 76/141] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:51 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:51.851378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:51.852981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:51.860714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.861231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.862214 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:51.862888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:51.944553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lazy-loading 'flavor' on Instance uuid 246af345-cb1b-449d-abe1-4be428cb9ee3 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:07:52.041590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:52.042826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:52.066130 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.066637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.067678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.067860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.146340 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-54ad92b5-7022-437d-86e4-54d1f4a4f588 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3/action" status: 200 len: 32 microversion: 2.1 time: 0.298507 Jul 11 14:07:52.147247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 66/142] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:07:51 2022] POST /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:07:52.158710 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:52.159411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:52.166324 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.167380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.168173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.168617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.289346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:52.301140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3f8ea965-dd43-4ad4-88f6-553f2e14a5ce tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.263738 Jul 11 14:07:52.302608 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 77/143] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:52 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:52.370266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:52.378510 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-99814060-9e35-46ab-84dd-82613ef9cf59 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.225913 Jul 11 14:07:52.379107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 67/144] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:52 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:52.499648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:52.500693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:52.509529 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.513898 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.516191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.516564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:52.517127 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.517879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:52.528860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.529310 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.530222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.531339 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.783465 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:52.799170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a166c593-20a7-4401-935a-b6b902729552 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.293665 Jul 11 14:07:52.802564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 78/145] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:52 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:52.816166 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:52.817107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:52.838438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.838899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.839851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:52.840322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:52.863637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:52.872313 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bddbaefa-fe03-451f-80ad-6798b1c8d9bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.376822 Jul 11 14:07:52.872957 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 68/146] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:52 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:52.997353 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:53.007932 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:53.010153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:53.011592 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d138383c-d98d-4950-9cdd-76aa0f18a12f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.207890 Jul 11 14:07:53.012199 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 79/147] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:52 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:53.319183 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:53.320165 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:53.327073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.327760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.328534 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.328959 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.395821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:53.396430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:53.403098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.403548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.404322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.404755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.506281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:53.514369 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bc708958-ca9d-4f51-bbed-c10f5a71dbca tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.198714 Jul 11 14:07:53.515451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 69/148] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:53 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:53.580267 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:53.588023 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-467cf735-e59c-4643-a2da-4395108c1aac tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.196182 Jul 11 14:07:53.588601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 80/149] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:53 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:53.820126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:53.821380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:53.824868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:53.829461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.829904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.830689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.831115 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.889127 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:53.889828 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:53.901372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.901822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:53.902612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:53.903041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.015985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.026073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0730f714-2f28-4dbc-b827-99e14ae3ea60 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.210395 Jul 11 14:07:54.038744 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 70/150] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:53 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:54.045522 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:54.047307 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:54.055495 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.056242 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.057213 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.058158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.065093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:54.071088 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.083689 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-55df95f0-07b6-4070-bd3e-6bdabccec666 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.198549 Jul 11 14:07:54.084711 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 81/151] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:53 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:54.205427 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.213429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.215085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.216278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f79a4d6a-e26d-4c91-b5f5-4d103057db79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.176183 Jul 11 14:07:54.219384 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 71/152] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:54 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:54.531153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:54.531850 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:54.537925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.538485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.539319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.539823 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.604974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:54.605721 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:54.611996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.612573 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.613450 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.613962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.717276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.725937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d125838d-6900-41a8-a9b5-8aacfbc60571 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.198691 Jul 11 14:07:54.730337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 82/153] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:54 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:54.749797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-0a5198f7-31bb-48c7-b3d6-96a4e6d6e8d8 req-0de56bc8-7df9-4ee1-a139-d8e89dd6cb26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "name": "network-vif-plugged", "status": "completed", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:54.759983 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-0a5198f7-31bb-48c7-b3d6-96a4e6d6e8d8 req-0de56bc8-7df9-4ee1-a139-d8e89dd6cb26 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:54.760432 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-0a5198f7-31bb-48c7-b3d6-96a4e6d6e8d8 req-0de56bc8-7df9-4ee1-a139-d8e89dd6cb26 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:54.773245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-0a5198f7-31bb-48c7-b3d6-96a4e6d6e8d8 req-0de56bc8-7df9-4ee1-a139-d8e89dd6cb26 service nova] Creating event network-vif-plugged:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:07:54.778942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-0a5198f7-31bb-48c7-b3d6-96a4e6d6e8d8 req-0de56bc8-7df9-4ee1-a139-d8e89dd6cb26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Jul 11 14:07:54.779638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 83/154] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:07:54.785909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:54.793612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-db1876bf-e108-41b7-8187-44ad7892495c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.192404 Jul 11 14:07:54.794630 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 72/155] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:54 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:55.046528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:55.047393 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:55.054469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.054921 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.055703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.056177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.105363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:55.105363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:55.116407 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.116874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.117646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.118123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.287699 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:55.295127 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d8f1fe52-14b2-49b0-977c-96c5970d72a5 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.253592 Jul 11 14:07:55.296136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 84/156] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:55 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:55.302155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:55.303168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:55.311704 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.312159 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.312927 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.313520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.321560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:55.330567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7f9afade-3e4e-4794-9312-8e1183a40793 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1367 microversion: 2.1 time: 0.231728 Jul 11 14:07:55.331418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 73/157] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:55 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:55.457233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:55.465683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:55.467280 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:55.468519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0a3f0e6f-1df1-43e7-a124-75c3fa5fd79e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.170653 Jul 11 14:07:55.469095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 85/158] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:55 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:55.743353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:55.744204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:55.751563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.752013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.752784 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.753406 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.812399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:55.812948 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:55.815966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:55.821411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.821858 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.822824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:55.823259 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:55.959958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:55.973891 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1a2a0692-b9dd-4088-a076-e8aa8435904f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.234042 Jul 11 14:07:55.985375 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 74/159] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:55 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:56.013432 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:56.022515 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8d0545e6-d0f9-4594-8267-3c01c3ef5744 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.214214 Jul 11 14:07:56.036244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 86/160] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:55 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:07:56.323875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:56.325226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:56.335976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.336665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.337603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.338186 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.349654 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:56.351219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:56.359810 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.360623 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.361602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.362846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.560842 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:56.568913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ab2c9453-5960-48f2-b532-fde422588750 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.254934 Jul 11 14:07:56.569774 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 75/161] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:56 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:56.574600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:56.587147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:56.589593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:56.599538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e9aba7f0-265b-4c0a-b870-a7b352dece1b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1557 microversion: 2.1 time: 0.253927 Jul 11 14:07:56.611825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.611825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.611825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.611825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.612814 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 87/162] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:56 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:56.618001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:56.618821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:56.625622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.626067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.626886 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:56.627325 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:56.788320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:56.795424 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a8523c70-a533-4b44-a40f-d5685cbcd013 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181276 Jul 11 14:07:56.796470 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 88/163] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:07:56 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:56.802215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:56.807986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:56.812560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c553f9c7-8f72-4fc8-a5ae-5ef36450cf97 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.240434 Jul 11 14:07:56.813409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 76/164] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:56 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:56.993539 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:56.994271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:57.009514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.010588 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.013204 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.016031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.042643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:57.043547 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:57.056093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.067614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.068646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.075297 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.817235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:57.820189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:57.831563 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-893c537d-913d-4ef0-ade6-ac13ac33141b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.843014 Jul 11 14:07:57.832451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 89/165] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:56 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:57.838359 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:57.839366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:57.844725 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-41e1902d-326a-47ba-9302-73c197381963 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.808061 Jul 11 14:07:57.845674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 77/166] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:57 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:57.848311 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.849170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.850241 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:57.850537 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.850873 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:57.851399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.863450 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.863890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:57.864682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:57.865120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:58.091518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:58.104572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-84295f2b-4a4a-4d92-a3b7-45eabd519050 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.270058 Jul 11 14:07:58.105704 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 90/167] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:57 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:58.106798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:58.116232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:58.117747 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:58.118926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-afdd3bdc-2df5-425b-91ed-473270fd03ce tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.272290 Jul 11 14:07:58.129887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 78/168] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:57 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:58.848171 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:58.848783 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:58.854903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:58.855551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:58.856607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:58.857233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:58.863935 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:58.864605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:58.871586 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:58.872376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:58.873757 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:58.875064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.105265 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:59.117247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ff0c90b0-a7d9-4b07-bb41-529358dd34db tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.259036 Jul 11 14:07:59.120550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 79/169] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:58 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:59.127623 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-22eb6e4b-1222-4e90-b735-d70ba684d73d req-5726a128-1039-4002-bae3-71174609a270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c538a6-c82b-4cc8-be39-aecd9c223140", "name": "network-vif-plugged", "status": "completed", "tag": "57d96d85-ab17-428a-92d7-20cf06bf4d35"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:59.152262 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-22eb6e4b-1222-4e90-b735-d70ba684d73d req-5726a128-1039-4002-bae3-71174609a270 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.153015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-22eb6e4b-1222-4e90-b735-d70ba684d73d req-5726a128-1039-4002-bae3-71174609a270 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.168431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-22eb6e4b-1222-4e90-b735-d70ba684d73d req-5726a128-1039-4002-bae3-71174609a270 service nova] Creating event network-vif-plugged:57d96d85-ab17-428a-92d7-20cf06bf4d35 for instance e4c538a6-c82b-4cc8-be39-aecd9c223140 on hv-cinder-84842 Jul 11 14:07:59.172782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:59.176180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:59.181481 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8d69e772-7e8a-4178-a549-e1049c7620fe tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.337091 Jul 11 14:07:59.182072 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 91/170] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:58 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:59.182200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-22eb6e4b-1222-4e90-b735-d70ba684d73d req-5726a128-1039-4002-bae3-71174609a270 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059853 Jul 11 14:07:59.183734 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 80/171] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:59.187908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-59d17e8c-1c27-4736-aed3-40a8717649c4 req-739ce3a9-0444-4555-86ae-716256b661eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bf941c-f166-4236-b1dc-c7943dfa23cb", "tag": "60d6a63c-f969-420e-97a5-2a6fcfdfeaa4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:59.189645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:59.190609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:59.199874 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-59d17e8c-1c27-4736-aed3-40a8717649c4 req-739ce3a9-0444-4555-86ae-716256b661eb service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.200324 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-59d17e8c-1c27-4736-aed3-40a8717649c4 req-739ce3a9-0444-4555-86ae-716256b661eb service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.200866 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.201658 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.202932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.203534 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.213002 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-59d17e8c-1c27-4736-aed3-40a8717649c4 req-739ce3a9-0444-4555-86ae-716256b661eb service nova] Creating event network-changed:60d6a63c-f969-420e-97a5-2a6fcfdfeaa4 for instance b2bf941c-f166-4236-b1dc-c7943dfa23cb on hv-cinder-84842 Jul 11 14:07:59.219442 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-59d17e8c-1c27-4736-aed3-40a8717649c4 req-739ce3a9-0444-4555-86ae-716256b661eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035877 Jul 11 14:07:59.221302 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 92/172] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:07:59.227779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:59.228732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:07:59.236389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.236974 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.237894 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.239972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.413605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:59.426402 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:59.428545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:59.429891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-000dcc03-b2ca-498a-8eb9-7004eb84efbd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1406 microversion: 2.20 time: 0.207428 Jul 11 14:07:59.431005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 93/173] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:07:59 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:07:59.435970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-657760888", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:07:59.449830 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:07:59.460008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ab71dfa5-4c69-4c9d-addc-7735d473ee0c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.274776 Jul 11 14:07:59.461050 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 81/174] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:59 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:07:59.512546 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] validate_networks() for None {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:07:59.805917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:07:59.806385 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:07:59.806864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:07:59.807266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:07:59.807665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:07:59.817400 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.817923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.818803 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:07:59.819234 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:07:59.837822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Getting quotas for project 809cb51806b54475bc876aaa27c556c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:07:59.842026 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Getting quotas for user e1fcaa2414f44632b0ed99f7f150a013 and project 809cb51806b54475bc876aaa27c556c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:07:59.860979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:07:59.863426 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:07:59.916428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-68596402-39cc-440d-93af-849f12dcd2fd tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484105 Jul 11 14:07:59.917257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 94/175] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:07:59.927451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7863a8ab-0fa0-441b-9c9e-db4e048a5dd7 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:07:59.928061 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7863a8ab-0fa0-441b-9c9e-db4e048a5dd7 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:00.008811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7863a8ab-0fa0-441b-9c9e-db4e048a5dd7 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.016778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7863a8ab-0fa0-441b-9c9e-db4e048a5dd7 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1214 microversion: 2.1 time: 0.093311 Jul 11 14:08:00.018658 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 82/176] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:07:59 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:00.138485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:00.139223 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:00.150224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.151985 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.152992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.153601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.199446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:00.200808 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:00.207743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.208420 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.209419 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.211709 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.570713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.583346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6ad31dfc-f971-4d77-b6ea-097da206c2ed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.388380 Jul 11 14:08:00.584175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 83/177] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:00 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:00.588896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:00.589497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:00.607948 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.608975 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.609771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.610202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.648396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.662964 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-697eb2e8-aaae-4d4e-af7a-b604b5ef8a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.528180 Jul 11 14:08:00.663976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 95/178] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:00 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:00.680826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:00.690642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:00.696952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.697638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.704374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.704892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.865511 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.873670 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.875970 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.877761 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f853e8b1-a9b9-4c72-87fd-5ff190611005 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1598 microversion: 2.20 time: 0.292474 Jul 11 14:08:00.891609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 84/179] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:08:00 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1598 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:08:00.893896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:00.896745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:00.897338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:00.903239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cfce7d1c-1434-4d27-8099-60bb0e6993ac tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1315 microversion: 2.1 time: 0.238155 Jul 11 14:08:00.904468 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 96/180] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:00 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:00.904772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.905264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.906021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:00.906481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:00.993432 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f5fad165-0adb-4795-ad15-d3f062406a27 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100355 Jul 11 14:08:00.994063 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 85/181] 10.222.0.49 () {60 vars in 1315 bytes} [Mon Jul 11 14:08:00 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:08:01.035291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:01.036180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:01.043195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:01.043863 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:01.044628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:01.045053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:01.167322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:01.179772 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d284ff24-2a64-42b3-ba64-06b74b873e18 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1218 microversion: 2.1 time: 0.148624 Jul 11 14:08:01.190929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 97/182] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:01 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:01.615092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:01.615951 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:01.625032 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:01.625837 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:01.627477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:01.628113 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:01.681976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:01.682624 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:01.689668 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:01.690436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:01.691504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:01.692270 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:02.132871 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:02.144330 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-57a81860-47a4-420c-9d40-d4905c7a2b9c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.466101 Jul 11 14:08:02.146753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 98/183] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:01 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:02.153323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:02.154607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:02.163855 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:02.164922 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:02.165951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:02.166876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:02.384966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:02.395557 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dbea0b1b-8f89-456f-96c3-089f4b0f3d62 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.786537 Jul 11 14:08:02.403207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 86/184] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:01 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:02.408872 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:02.409973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:02.417357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:02.419797 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:02.421883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:02.433147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:02.535849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:02.543830 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1dc82528-7d17-445d-90b1-bfc92eede13d tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1266 microversion: 2.1 time: 0.146030 Jul 11 14:08:02.548778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 87/185] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:02 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:02.678754 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:02.687528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3316f4b1-064a-4df4-a474-c2c2d7772d24 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1502 microversion: 2.1 time: 0.539210 Jul 11 14:08:02.688197 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 99/186] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:02 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1502 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:03.023718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-b54403db-a44a-462d-8119-bdb460122860 req-aaf575ff-30a8-4063-a0b2-fe3323194881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:03.040418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b54403db-a44a-462d-8119-bdb460122860 req-aaf575ff-30a8-4063-a0b2-fe3323194881 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.040973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-b54403db-a44a-462d-8119-bdb460122860 req-aaf575ff-30a8-4063-a0b2-fe3323194881 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.066241 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-b54403db-a44a-462d-8119-bdb460122860 req-aaf575ff-30a8-4063-a0b2-fe3323194881 service nova] Creating event network-changed:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:08:03.079970 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-b54403db-a44a-462d-8119-bdb460122860 req-aaf575ff-30a8-4063-a0b2-fe3323194881 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059930 Jul 11 14:08:03.082414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 88/187] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:03.164005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:03.164699 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:03.177425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.179054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.180799 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.181732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.388679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:03.396763 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d7bb3658-4399-42d2-b1ff-21b9cb1f2cae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.237871 Jul 11 14:08:03.397567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 100/188] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:03 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:03.418880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:03.419657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:03.426282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.427126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.428102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.428591 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.563958 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:03.565409 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:03.574377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.575044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.579798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:03.583459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:03.584302 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:03.590611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6fc7ce98-9935-4465-9a79-3bfa78838dad tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.175082 Jul 11 14:08:03.591536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 89/189] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:03 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:03.662751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:03.670334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2a170234-5c30-4b2f-bc35-1d6c784846bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1274 microversion: 2.1 time: 0.113197 Jul 11 14:08:03.680928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 101/190] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:03 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:04.415225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:04.415833 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:04.426275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:04.427178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:04.427952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:04.428657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:04.450802 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:04.576075 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:04.585281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1ba21a12-2768-4d63-b15c-afa9c3f6ea92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.173858 Jul 11 14:08:04.591083 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 90/191] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:04 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:04.607791 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:04.608449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:04.614874 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:04.615327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:04.616115 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:04.616554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:04.690935 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:04.696228 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:04.703465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:04.704029 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:04.704912 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:04.705446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:04.815738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:04.826861 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fa10ae5b-392a-4f0e-9080-99d8531f9ba8 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1272 microversion: 2.1 time: 0.141967 Jul 11 14:08:04.827497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 91/192] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:04 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:04.839235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:04.882700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-281a2515-9c20-42a1-98ad-154b085a66a5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1360 microversion: 2.1 time: 0.278588 Jul 11 14:08:04.887844 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 102/193] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:04 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1360 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:05.192992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01bc9d02-ff30-4081-bb95-d8f4cb2f9404"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:05.194640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:05.203417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.204477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.205303 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.205735 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.602464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:05.603085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:05.610135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.611299 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.612087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.612528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.758374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:05.766762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ec2ce5dd-0702-455e-b2e7-2fe1e9c3c5fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.168097 Jul 11 14:08:05.767340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 103/194] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:05 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:05.844485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:05.845095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:05.851772 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.852218 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.852989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.853425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.928209 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:05.940375 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c909d1e6-c958-4516-9bd4-5bb5a726024e tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1272 microversion: 2.1 time: 0.099666 Jul 11 14:08:05.941081 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 104/195] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:05 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:05.947307 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:05.948796 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:05.955321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.955773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:05.956542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:05.956978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:06.101793 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:06.109259 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9a8e79df-d041-471f-9798-04cc98300816 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1546 microversion: 2.1 time: 0.167141 Jul 11 14:08:06.109831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 105/196] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:05 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:06.126124 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:06.126712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:06.133202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:06.133791 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:06.134759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:06.135443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:06.235761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-92fc6e18-7fa5-46ca-b3a0-e37a44e66bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113583 Jul 11 14:08:06.236795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 106/197] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:08:06 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:06.479219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-96f1d214-c390-4c40-8a38-83af26d318b8 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "POST /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.289639 Jul 11 14:08:06.481864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 92/198] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:08:05 2022] POST /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677/os-volume_attachments => generated 194 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:06.784813 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:06.786249 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:06.793568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:06.794012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:06.794817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:06.795419 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:06.960055 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:06.961181 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:06.969107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:06.970547 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:06.971653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:06.972485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:07.104105 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:07.112469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ac9204d9-de53-4823-b20c-7d072ec8bcba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.332104 Jul 11 14:08:07.113687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 107/199] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:06 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:07.208912 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:07.218907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-26f77ca8-e8ab-4948-83ea-25663b1baf36 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.265096 Jul 11 14:08:07.219909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 93/200] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:06 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:07.506239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-1eb7e3d8-8a62-4771-aa57-de5c3f07547e req-422c18e7-80e0-49cd-8741-15dd7e499a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c538a6-c82b-4cc8-be39-aecd9c223140", "tag": "57d96d85-ab17-428a-92d7-20cf06bf4d35"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:07.521186 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-1eb7e3d8-8a62-4771-aa57-de5c3f07547e req-422c18e7-80e0-49cd-8741-15dd7e499a92 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:07.521821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-1eb7e3d8-8a62-4771-aa57-de5c3f07547e req-422c18e7-80e0-49cd-8741-15dd7e499a92 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:07.536285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-1eb7e3d8-8a62-4771-aa57-de5c3f07547e req-422c18e7-80e0-49cd-8741-15dd7e499a92 service nova] Creating event network-changed:57d96d85-ab17-428a-92d7-20cf06bf4d35 for instance e4c538a6-c82b-4cc8-be39-aecd9c223140 on hv-cinder-84842 Jul 11 14:08:07.544027 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-1eb7e3d8-8a62-4771-aa57-de5c3f07547e req-422c18e7-80e0-49cd-8741-15dd7e499a92 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041204 Jul 11 14:08:07.544783 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 108/201] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:07.705167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-ae0f2412-bbb2-42e5-a52d-7473973d61a6 req-f6cf912e-30fa-453f-8200-d9aab1e037be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722086bc-0d3a-4ee3-b7d0-735617950ea8", "tag": "3f53ff20-3058-4023-9acb-1ecb13563140"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:07.716663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-ae0f2412-bbb2-42e5-a52d-7473973d61a6 req-f6cf912e-30fa-453f-8200-d9aab1e037be service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:07.717117 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-ae0f2412-bbb2-42e5-a52d-7473973d61a6 req-f6cf912e-30fa-453f-8200-d9aab1e037be service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:07.737960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-ae0f2412-bbb2-42e5-a52d-7473973d61a6 req-f6cf912e-30fa-453f-8200-d9aab1e037be service nova] Creating event network-changed:3f53ff20-3058-4023-9acb-1ecb13563140 for instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 on hv-cinder-84842 Jul 11 14:08:07.742902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-ae0f2412-bbb2-42e5-a52d-7473973d61a6 req-f6cf912e-30fa-453f-8200-d9aab1e037be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044629 Jul 11 14:08:07.743679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 94/202] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:08.129659 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:08.130552 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:08.137068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:08.137521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:08.138332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:08.138775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:08.237192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:08.237888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:08.244558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:08.245277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:08.246044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:08.246677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:08.299989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:08.308177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6e5ff783-9c18-4f2c-b524-c6852e463593 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.182685 Jul 11 14:08:08.308857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 109/203] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:08 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:08.401438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:08.409657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4353162c-076c-4907-8509-57723495d6bb tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.176686 Jul 11 14:08:08.410504 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 95/204] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:08 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:09.326857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:09.327577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:09.334407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:09.334861 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:09.335639 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:09.336081 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:09.426575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:09.427752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:09.434637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:09.435107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:09.435864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:09.436800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:09.470702 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:09.474117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:09.478993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6c9d0e3b-ab76-4356-b6cd-9690b6fdf7d1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.156788 Jul 11 14:08:09.480284 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 110/205] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:09 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:09.572058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:09.580765 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-db0f544b-73b7-444b-bc73-fe58d2cb1df0 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.157870 Jul 11 14:08:09.581246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 96/206] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:09 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:10.496626 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:10.497263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:10.499166 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:10.500232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:10.506824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:10.507276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:10.508087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:10.508563 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:10.597550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:10.598256 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:10.600736 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:10.607352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:10.607916 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:10.608768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:10.609293 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:10.649891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:10.669546 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fc779715-6e81-46da-aa72-c258cea0a8b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.177466 Jul 11 14:08:10.670222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 111/207] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:10 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:10.755058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:10.762982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-00fe7ec3-68ab-4d48-8a9b-576964ea4313 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.169892 Jul 11 14:08:10.773141 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 97/208] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:10 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:11.687304 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:11.687930 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:11.693988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:11.694466 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:11.695229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:11.695662 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:11.779967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:11.780684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:11.788032 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:11.788478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:11.789247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:11.789679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:11.839717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:11.847948 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-165828d8-d8c9-4b55-9ec1-9c17412041bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.164429 Jul 11 14:08:11.848504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 112/209] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:11 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:11.926064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:11.933947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3cee1434-f806-42d8-a867-3745668eb206 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.157774 Jul 11 14:08:11.934576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 98/210] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:11 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:12.864581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:12.865282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:12.871145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:12.871594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:12.872375 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:12.872905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:12.951145 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:12.951704 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:12.958880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:12.959331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:12.960458 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:12.960896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:13.010652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:13.018621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-60a895e8-c4d2-45fc-8152-0405166e7713 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.157828 Jul 11 14:08:13.019199 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 113/211] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:12 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:13.099828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:13.107550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-89a27eb6-5748-4a71-9c2d-1fe95fb0e4bf tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.160597 Jul 11 14:08:13.108097 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 99/212] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:12 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:14.035565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:14.036202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:14.042365 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:14.042819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:14.043582 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:14.044021 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:14.124972 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:14.125650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:14.132450 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:14.133114 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:14.133883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:14.134345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:14.187703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:14.195190 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ac7551f5-c042-4b32-91ee-3641cd29f4f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.164037 Jul 11 14:08:14.195764 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 114/213] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:14 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:14.274058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:14.281639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4431eb54-8718-48a1-b832-2e9e06ac23d6 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.160514 Jul 11 14:08:14.282317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 100/214] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:14 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:15.212977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:15.213581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:15.220010 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:15.220479 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:15.221324 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:15.221900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:15.299943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:15.300546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:15.307501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:15.307954 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:15.308721 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:15.309151 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:15.365613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:15.373266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a07f07b4-cbae-488f-b733-ff78d23c14ef tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.164210 Jul 11 14:08:15.373849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 115/215] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:15 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:15.446656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:15.454184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3f899d5a-4f1a-46db-adba-2cc4500922aa tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.158992 Jul 11 14:08:15.454834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 101/216] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:15 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:16.390431 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:16.391139 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:16.398337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:16.398891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:16.399669 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:16.400108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:16.470226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:16.470941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:16.477778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:16.478294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:16.479145 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:16.479825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:16.576948 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:16.587915 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-104a4670-afb5-43a2-9e61-67bd195256ea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.201245 Jul 11 14:08:16.588523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 116/217] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:16 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:16.638595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:16.646092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d33b2aba-13b5-4656-acd6-510139eab608 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.179707 Jul 11 14:08:16.646692 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 102/218] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:16 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:17.212681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:17.213415 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:17.220785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.221252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.222018 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.222503 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.253445 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:08:17.354001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bfb957f7-5813-4289-b046-9661b8f64221 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 204 len: 0 microversion: 2.1 time: 0.144818 Jul 11 14:08:17.355453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 117/219] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:08:17 2022] DELETE /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:08:17.363238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:17.363848 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:17.369988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.370482 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.371254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.371718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.507623 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:17.515738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-08e755b7-5374-441d-b17b-049ed5c0164c tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1554 microversion: 2.1 time: 0.156399 Jul 11 14:08:17.516301 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 103/220] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:17 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:17.605532 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:17.606224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:17.612822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.613267 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.614034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.614515 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.663128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:17.663845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:17.670026 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.670508 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.671277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:17.671714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:17.793167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:17.802750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7b575108-badc-459c-b31d-fe2d9592f9e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.201313 Jul 11 14:08:17.803341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 118/221] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:17 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:17.839404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:17.847180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2dec1c31-be6e-4822-8fc9-acc2343d1300 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.187850 Jul 11 14:08:17.847738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 104/222] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:17 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:18.063483 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-ee3bb017-64a8-4904-abce-0666cf582c84 req-552a2292-a1cd-4939-9ddc-9772f28bd6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722086bc-0d3a-4ee3-b7d0-735617950ea8", "name": "network-vif-plugged", "status": "completed", "tag": "3f53ff20-3058-4023-9acb-1ecb13563140"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:18.077730 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ee3bb017-64a8-4904-abce-0666cf582c84 req-552a2292-a1cd-4939-9ddc-9772f28bd6da service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.078173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ee3bb017-64a8-4904-abce-0666cf582c84 req-552a2292-a1cd-4939-9ddc-9772f28bd6da service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.089504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-ee3bb017-64a8-4904-abce-0666cf582c84 req-552a2292-a1cd-4939-9ddc-9772f28bd6da service nova] Creating event network-vif-plugged:3f53ff20-3058-4023-9acb-1ecb13563140 for instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 on hv-cinder-84842 Jul 11 14:08:18.094513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-ee3bb017-64a8-4904-abce-0666cf582c84 req-552a2292-a1cd-4939-9ddc-9772f28bd6da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034634 Jul 11 14:08:18.095153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 119/223] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:18.533479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:18.534085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:18.540530 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.540983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.541746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.542182 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.675750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:18.684352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-20885550-e9db-4dfa-92fc-c32c792c906d tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1554 microversion: 2.1 time: 0.155280 Jul 11 14:08:18.684924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 105/224] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:18 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:18.820093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:18.820792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:18.828506 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.828920 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.830187 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.830706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.866672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:18.867391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:18.874285 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.874962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.875549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:18.875978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:18.891511 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:19.030372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:19.038820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-75ed9f25-fc1a-42af-8ec9-2479c6a0e5cb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.222864 Jul 11 14:08:19.039638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 120/225] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:18 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:19.057208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:19.065871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-63c1079d-9622-4266-9352-67b90e55f512 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.205445 Jul 11 14:08:19.066627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 106/226] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:18 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:19.700794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:19.703134 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:19.710377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:19.710919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:19.712079 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:19.712592 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:19.855881 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:19.866979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d1630eb7-4a7f-4a66-a206-7922cf4440d4 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1554 microversion: 2.1 time: 0.169914 Jul 11 14:08:19.867560 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 121/227] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:19 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:20.056125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:20.056728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:20.063723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:20.064191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:20.064951 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:20.065428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:20.083193 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:20.083775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:20.090733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:20.091173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:20.091931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:20.092373 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:20.291328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:20.294849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:20.300933 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3b897e5f-b370-4af2-b666-25c0722b2296 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.249110 Jul 11 14:08:20.303857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-afcf3f72-a48a-49bf-b390-c64acc251758 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.224741 Jul 11 14:08:20.304430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 122/228] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:20 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:20.312340 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 107/229] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:20 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:20.885611 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:20.886469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:20.893087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:20.893533 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:20.894330 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:20.894769 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:21.262441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:21.272454 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dea7470a-e7ec-49e8-893c-c42098006197 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1554 microversion: 2.1 time: 0.390558 Jul 11 14:08:21.273051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 123/230] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:20 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1554 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:21.318153 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:21.319069 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:21.321819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:21.322616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:21.326093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:21.326578 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:21.327526 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:21.327964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:21.328615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:21.329093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:21.330020 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:21.330652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:21.539820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:21.542138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:21.549286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eaef27c7-3f84-49a4-8de8-f127f188ba4f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1314 microversion: 2.1 time: 0.230972 Jul 11 14:08:21.550106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 124/231] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:21 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:21.559253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c2e6f701-210e-4900-a2e7-a31ac4ca8a8f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.237600 Jul 11 14:08:21.559253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 108/232] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:21 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:22.289395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:22.290007 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:22.298021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:22.298539 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:22.299327 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:22.299771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:22.543229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:22.554661 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8e3bab82-ed1c-43df-ab59-706dad38c9e1 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1554 microversion: 2.1 time: 0.269199 Jul 11 14:08:22.555376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 109/233] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:22 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:22.570743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:22.571886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:22.572523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:22.572654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:22.583864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:22.584577 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:22.585645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:22.586279 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:22.588353 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:22.588807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:22.589751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:22.590403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:22.994135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:23.003974 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:23.006113 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-930a8dcd-2ca0-4760-8f79-da0bfe73eac0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.442034 Jul 11 14:08:23.007615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 110/234] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:22 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:23.021913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a9765028-8512-4820-8479-38c7c4cbd928 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1464 microversion: 2.1 time: 0.459118 Jul 11 14:08:23.022852 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 125/235] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:22 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1464 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:23.085959 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:23.086490 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:23.093926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.094626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.096104 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.096750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.141712 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:08:23.177939 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-34bb695b-41e2-4d72-8972-c6780a48df38 req-5de8b865-17bf-4e3f-8a03-ab1141f54667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ee777f-fba0-48b0-895e-8f63700a5677", "name": "network-vif-deleted", "tag": "7e6fb041-72fb-48ee-8444-5e1261b51dfd"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:23.182896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:23.196765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-34bb695b-41e2-4d72-8972-c6780a48df38 req-5de8b865-17bf-4e3f-8a03-ab1141f54667 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.197555 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-34bb695b-41e2-4d72-8972-c6780a48df38 req-5de8b865-17bf-4e3f-8a03-ab1141f54667 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.228817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-34bb695b-41e2-4d72-8972-c6780a48df38 req-5de8b865-17bf-4e3f-8a03-ab1141f54667 service nova] Creating event network-vif-deleted:7e6fb041-72fb-48ee-8444-5e1261b51dfd for instance 79ee777f-fba0-48b0-895e-8f63700a5677 on hv-cinder-84842 Jul 11 14:08:23.234509 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-34bb695b-41e2-4d72-8972-c6780a48df38 req-5de8b865-17bf-4e3f-8a03-ab1141f54667 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065377 Jul 11 14:08:23.235269 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 126/236] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:23.289798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-37c1a9e1-e2f3-4a2e-b860-6712d196d22c tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "DELETE /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 204 len: 0 microversion: 2.1 time: 0.207474 Jul 11 14:08:23.290798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 111/237] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:08:23 2022] DELETE /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:08:23.302969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:23.303685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:23.321700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.322503 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.323627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.324224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.333498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:23.573723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:23.574380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:23.580009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:23.582654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.583104 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.584583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:23.585027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:23.589258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3af19014-b037-4ef3-bd07-55351d6db69f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1470 microversion: 2.1 time: 0.294306 Jul 11 14:08:23.590760 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 127/238] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:23 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:23.687287 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:23.695895 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4fe6f948-54f9-4d29-b462-e70a582ad0fd tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1346 microversion: 2.1 time: 0.126549 Jul 11 14:08:23.705933 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 112/239] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:23 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:24.025033 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:24.025648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:24.031727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:24.032168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:24.032968 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:24.033397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:24.177755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:24.196002 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2356c603-cfae-4ade-8e95-e4b7e0765a2a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.176362 Jul 11 14:08:24.196600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 128/240] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:24 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:24.608123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:24.608745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:24.613036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:24.622032 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:24.623822 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:24.625009 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:24.625615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:24.713931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:24.714677 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:24.733436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:24.734133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:24.735048 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:24.735785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:24.841425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:24.859230 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3b0c58cb-0acb-478e-b20e-54d90f45eeb6 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1346 microversion: 2.1 time: 0.149776 Jul 11 14:08:24.863104 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 129/241] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:24 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:24.887094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:24.895064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-405f6fea-07ce-4d72-8866-eeead5fea4e3 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1470 microversion: 2.1 time: 0.290922 Jul 11 14:08:24.895922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 113/242] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:24 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:25.213524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:25.216526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:25.225244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.226040 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.227297 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.228120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.397613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:25.413552 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d198549a-69c6-4caa-8e97-120eeac2660d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.203229 Jul 11 14:08:25.415914 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 130/243] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:25 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:25.881118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:25.882006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:25.892595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.897392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.897392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.897392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.913620 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:25.914844 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:25.922196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.924493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.925454 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.926043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.936338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:25.936777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:25.937222 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lazy-loading 'fault' on Instance uuid 79ee777f-fba0-48b0-895e-8f63700a5677 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:08:26.008455 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170f249dccd4498990a8344a18c73059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7136b6633c6e4d399a6d359d750125f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:26.018781 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a89e1f7a-0f2f-488b-a78f-41f555956cca tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 200 len: 1351 microversion: 2.1 time: 0.144762 Jul 11 14:08:26.019361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 114/244] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:25 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 1351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:26.136309 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:26.147489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-37526a9a-2d20-4a3c-8f64-c6d4418b4b5f tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1470 microversion: 2.1 time: 0.237683 Jul 11 14:08:26.150376 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 131/245] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:25 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:26.432582 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:26.433277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:26.439950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:26.440403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:26.441400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:26.441868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:26.588396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:26.603339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-69cf3cf1-27a4-4ce2-a907-9981f8434227 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.174409 Jul 11 14:08:26.604824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 115/246] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:26 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:26.962960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-f43187c9-173c-4606-9dc7-09a6bb853307 req-18954bbb-2011-46a2-9a3b-b453fc3eeaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722086bc-0d3a-4ee3-b7d0-735617950ea8", "name": "network-vif-deleted", "tag": "3f53ff20-3058-4023-9acb-1ecb13563140"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:26.974919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f43187c9-173c-4606-9dc7-09a6bb853307 req-18954bbb-2011-46a2-9a3b-b453fc3eeaba service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:26.975824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f43187c9-173c-4606-9dc7-09a6bb853307 req-18954bbb-2011-46a2-9a3b-b453fc3eeaba service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:26.998344 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-f43187c9-173c-4606-9dc7-09a6bb853307 req-18954bbb-2011-46a2-9a3b-b453fc3eeaba service nova] Creating event network-vif-deleted:3f53ff20-3058-4023-9acb-1ecb13563140 for instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 on hv-cinder-84842 Jul 11 14:08:27.008076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-f43187c9-173c-4606-9dc7-09a6bb853307 req-18954bbb-2011-46a2-9a3b-b453fc3eeaba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049111 Jul 11 14:08:27.008693 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 132/247] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:27.037473 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:27.039147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:27.058681 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.067188 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.068321 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.068922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.091534 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] HTTP exception thrown: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Request method failure captured: Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 HTTP/1.1 Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6MK43zJJdr56-Bn_HFHyE7BOW1eiuak9uYDFno4uw9O_OIUpm8Xy1OQU3ufnyfmU-GsxkGzEC9UtBPIA-jA9uk0s-pU3YHjUhX2tO5I9cRBqelYxDfOyobyY2U19fqvtBXk4JCi__To1fzw53esbCV5KoCLFdS-qVaUojSkIYPnPk Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:08:27.096968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7136b6633c6e4d399a6d359d750125f0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}] Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 170f249dccd4498990a8344a18c73059 Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.098636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '79ee777f-fba0-48b0-895e-8f63700a5677'} Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:08:27.099625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.101060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.103164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Returning 404 to user: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:08:27.104230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-176eb55d-6e76-40cc-9fac-ea5300828daa tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 404 len: 111 microversion: 2.1 time: 0.071327 Jul 11 14:08:27.105321 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 116/248] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:27 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:08:27.177552 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:27.178800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:27.200187 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.207368 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.211055 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.211882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.257239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.257758 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.258290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lazy-loading 'fault' on Instance uuid 722086bc-0d3a-4ee3-b7d0-735617950ea8 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:08:27.270682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:27.272701 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:27.281988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.283724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.284759 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.285394 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.302742 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] HTTP exception thrown: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Request method failure captured: Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677/os-volume_attachments HTTP/1.1 Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6MK43zJJdr56-Bn_HFHyE7BOW1eiuak9uYDFno4uw9O_OIUpm8Xy1OQU3ufnyfmU-GsxkGzEC9UtBPIA-jA9uk0s-pU3YHjUhX2tO5I9cRBqelYxDfOyobyY2U19fqvtBXk4JCi__To1fzw53esbCV5KoCLFdS-qVaUojSkIYPnPk Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:08:27.312607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7136b6633c6e4d399a6d359d750125f0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}] Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 170f249dccd4498990a8344a18c73059 Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.314791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'server_id': '79ee777f-fba0-48b0-895e-8f63700a5677'} Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:08:27.315601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:27.317348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:27.319906 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Returning 404 to user: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:08:27.319906 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5f310257-8b04-406c-a862-fb2beec6842f tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053519 Jul 11 14:08:27.320717 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 117/249] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:08:27 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:08:27.341200 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fcaa2414f44632b0ed99f7f150a013', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '809cb51806b54475bc876aaa27c556c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:27.350625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-79883017-3b65-499b-af3c-5883ba53f364 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 200 len: 1304 microversion: 2.1 time: 0.186441 Jul 11 14:08:27.363530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 133/250] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:27 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 1304 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:27.621339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:27.622296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:27.630645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.631467 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.632573 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:27.633220 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:27.961198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:27.972461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2feaa0c6-2cc2-4135-a5cc-a9b0fd00965c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.354891 Jul 11 14:08:27.983956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 118/251] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:27 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:28.370409 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:28.371162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] [instance: 722086bc-0d3a-4ee3-b7d0-735617950ea8] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:28.384258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:28.386931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:28.387759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:28.388230 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:28.405476 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] HTTP exception thrown: Instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 could not be found. Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Request method failure captured: Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 HTTP/1.1 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC69nmkqviGf4lHSHwKR4zN9I4yVLscGsY6-QDGRqWYCsDi31lnxtzjGZ5upsQUHWSD4TERGQ6axBY71IHV3AXKqr2PPsahd7INUFtFFJcNTrZ7qUSca1--7wsW1xIlGfWxZmxRjeikSZDXcljCQeapKQZw0uE7E--13jqQSg8kIn08 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 809cb51806b54475bc876aaa27c556c0 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-8077508 Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:08:28.411521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_809cb51806b54475bc876aaa27c556c0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/809cb51806b54475bc876aaa27c556c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/809cb51806b54475bc876aaa27c556c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/809cb51806b54475bc876aaa27c556c0"}]}] Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-8077508 Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 809cb51806b54475bc876aaa27c556c0 Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-8077508 Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-8077508-project Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: e1fcaa2414f44632b0ed99f7f150a013 Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-8077508-project Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 could not be found. Jul 11 14:08:28.412965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '722086bc-0d3a-4ee3-b7d0-735617950ea8'} Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 could not be found. Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:08:28.413812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 could not be found. Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 could not be found. Jul 11 14:08:28.415182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.417017 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] Returning 404 to user: Instance 722086bc-0d3a-4ee3-b7d0-735617950ea8 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:08:28.418016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dc8eccc3-8c78-4dd1-93d9-40e829835c85 tempest-VolumesNegativeTest-8077508 tempest-VolumesNegativeTest-8077508-project] 10.222.0.49 "GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8" status: 404 len: 111 microversion: 2.1 time: 0.053634 Jul 11 14:08:28.422597 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 134/252] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:28 2022] GET /compute/v2.1/servers/722086bc-0d3a-4ee3-b7d0-735617950ea8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:08:28.581367 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:28.582062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:28.591922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:28.598547 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:28.599784 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:28.600439 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:28.630635 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] HTTP exception thrown: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Request method failure captured: Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 HTTP/1.1 Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6MK43zJJdr56-Bn_HFHyE7BOW1eiuak9uYDFno4uw9O_OIUpm8Xy1OQU3ufnyfmU-GsxkGzEC9UtBPIA-jA9uk0s-pU3YHjUhX2tO5I9cRBqelYxDfOyobyY2U19fqvtBXk4JCi__To1fzw53esbCV5KoCLFdS-qVaUojSkIYPnPk Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:08:28.640738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7136b6633c6e4d399a6d359d750125f0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}] Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 170f249dccd4498990a8344a18c73059 Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.642273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '79ee777f-fba0-48b0-895e-8f63700a5677'} Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:08:28.643118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.644418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.645743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Returning 404 to user: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:08:28.647904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b6b3857d-c398-4f54-94a0-7195a9524bc2 tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "DELETE /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 404 len: 111 microversion: 2.1 time: 0.069107 Jul 11 14:08:28.649828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 119/253] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:08:28 2022] DELETE /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:08:28.657200 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:28.657913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] [instance: 79ee777f-fba0-48b0-895e-8f63700a5677] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:28.664909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:28.665526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:28.666509 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:28.667098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:28.685205 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] HTTP exception thrown: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Request method failure captured: Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 HTTP/1.1 Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6MK43zJJdr56-Bn_HFHyE7BOW1eiuak9uYDFno4uw9O_OIUpm8Xy1OQU3ufnyfmU-GsxkGzEC9UtBPIA-jA9uk0s-pU3YHjUhX2tO5I9cRBqelYxDfOyobyY2U19fqvtBXk4JCi__To1fzw53esbCV5KoCLFdS-qVaUojSkIYPnPk Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:08:28.687009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7136b6633c6e4d399a6d359d750125f0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7136b6633c6e4d399a6d359d750125f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7136b6633c6e4d399a6d359d750125f0"}]}] Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 7136b6633c6e4d399a6d359d750125f0 Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-DeleteServersTestJSON-212600606 Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 170f249dccd4498990a8344a18c73059 Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-DeleteServersTestJSON-212600606-project Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.689007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '79ee777f-fba0-48b0-895e-8f63700a5677'} Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:08:28.689917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. Jul 11 14:08:28.691183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:08:28.693728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] Returning 404 to user: Instance 79ee777f-fba0-48b0-895e-8f63700a5677 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:08:28.694892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3963436b-fa3c-4f62-8b3b-267148f9c7af tempest-DeleteServersTestJSON-212600606 tempest-DeleteServersTestJSON-212600606-project] 10.222.0.49 "GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677" status: 404 len: 111 microversion: 2.1 time: 0.041771 Jul 11 14:08:28.696091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 135/254] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:28 2022] GET /compute/v2.1/servers/79ee777f-fba0-48b0-895e-8f63700a5677 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:08:28.991958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:28.993632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:29.006105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:29.007156 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:29.008507 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:29.010656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:29.869426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:29.877729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-40776d3d-9188-4457-9f3a-7a41ce8b46fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.890416 Jul 11 14:08:29.881887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 120/255] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:28 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:30.897912 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:30.898643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:30.910747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:30.914963 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:30.917743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:30.918547 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:31.272337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:31.283826 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f5a3181f-4d40-44a0-8b65-0482571c56da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.392817 Jul 11 14:08:31.298132 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 136/256] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:30 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:32.315500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:32.316924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:32.331034 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:32.332037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:32.333659 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:32.334392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:32.565541 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:32.575938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-45c02313-9dda-45a8-97bb-34805b901a96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.264822 Jul 11 14:08:32.591104 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 121/257] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:32 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:33.589443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-99c25412-af69-42ab-bb68-a4676f61cace tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Action: 'create', calling method: .version_select at 0x7ffad55eb670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1303563081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFYMB/DBjBJsq78U2gnEg9teUEd9QEmJMXleDFh5QaMODJY0HaUqTVfZ0eqXQ2hM6/ZHPeNlgBAtPOxbmnQohpzygXKSwEpdmNcQLiNuQIsYUjt3pIrmNZFq73akEz7QA=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:33.592100 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:33.592714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:33.601805 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:33.602721 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:33.606674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:33.607363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:33.612257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-99c25412-af69-42ab-bb68-a4676f61cace tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Getting quotas for project 2c01634e004b43239e6912ee0a9d1ffd. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:08:33.618677 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-99c25412-af69-42ab-bb68-a4676f61cace tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Getting quotas for user e12ac3751780495081b2ef41d13ba360 and project 2c01634e004b43239e6912ee0a9d1ffd. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:08:33.684239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-99c25412-af69-42ab-bb68-a4676f61cace tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.411241 Jul 11 14:08:33.685415 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 137/258] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:08:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:33.995560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:34.004945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-76aae7fa-3fd2-4af2-b26d-4266a275bbe5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.416440 Jul 11 14:08:34.005888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 122/259] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:33 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:35.024363 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:35.025424 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:35.057783 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:35.058245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:35.062167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:35.064103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:35.457736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:35.471550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-94432bd5-99c3-4398-9cfc-f5a497387475 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.449061 Jul 11 14:08:35.474362 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 138/260] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:35 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:36.493352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:36.526896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:36.543219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:36.544836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:36.553584 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:36.554524 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:36.564217 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:36.836960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:36.851114 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ccb29e72-361b-4857-af7f-3615d5ff6747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1522 microversion: 2.1 time: 0.365408 Jul 11 14:08:36.852353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 123/261] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:36 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:37.868879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:37.869495 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:37.876388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:37.876991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:37.877887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:37.878594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:38.007492 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:38.014917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4a92584b-95ee-4735-b426-6ae0e044b38d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1502 microversion: 2.1 time: 0.149999 Jul 11 14:08:38.015477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 139/262] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:37 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:38.031553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:38.032898 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:38.039206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:38.039659 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:38.040421 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:38.040859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:38.174603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:38.182401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ff7e835c-c0b7-45c4-bde7-385dabbf88f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1516 microversion: 2.1 time: 0.154758 Jul 11 14:08:38.182900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 124/263] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:38 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:39.828292 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5099b58d-b17b-4f35-85b6-1415d19b3deb tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad536fa60>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:39.883820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5099b58d-b17b-4f35-85b6-1415d19b3deb tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/07b2f5cd-2901-415d-94a2-b7580103b8f3" status: 200 len: 349 microversion: 2.1 time: 0.059720 Jul 11 14:08:39.884403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 140/264] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:08:39 2022] GET /compute/v2.1/os-volumes/07b2f5cd-2901-415d-94a2-b7580103b8f3 => generated 349 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:40.609457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:40.610576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:40.616965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:40.617407 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:40.618149 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:40.618611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:40.641716 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lazy-loading 'flavor' on Instance uuid 7d8c2737-675e-4124-86c5-2c06d1d65991 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:08:40.716527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-58c4e95c-04ee-41e2-96bc-052f53323f92 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/action" status: 200 len: 32 microversion: 2.1 time: 0.110914 Jul 11 14:08:40.717469 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 125/265] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:08:40 2022] POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:08:40.728038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:40.728965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:40.736070 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:40.736573 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:40.737361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:40.737800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:41.123895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:41.131792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-25321613-a04b-4d4b-8b81-c96c12f82a39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.408379 Jul 11 14:08:41.132595 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 141/266] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:40 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:42.150258 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:42.150996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:42.158233 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:42.158706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:42.159466 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:42.159906 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:42.268216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3a12d8a3-5860-4096-9c95-6ce43435d39e tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad5448dc0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:42.291313 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:42.314006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d33bc33c-6386-4d3d-8926-840281a28cfc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.167850 Jul 11 14:08:42.314721 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 126/267] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:42 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:42.329158 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3a12d8a3-5860-4096-9c95-6ce43435d39e tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/290ee559-06b2-4388-be93-d4e0e8b6b494" status: 200 len: 350 microversion: 2.1 time: 0.064624 Jul 11 14:08:42.335670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 142/268] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:08:42 2022] GET /compute/v2.1/os-volumes/290ee559-06b2-4388-be93-d4e0e8b6b494 => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:43.330272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:43.330921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:43.337449 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:43.337887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:43.338657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:43.339085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:43.470972 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:43.478270 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dd509096-dc8d-49fc-85c6-097cf0bc8d3f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.151929 Jul 11 14:08:43.478878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 127/269] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:43 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:44.492262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:44.496116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:44.496714 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:44.503553 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:44.503994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:44.504745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:44.505175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:44.631393 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:44.639032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1a5d445c-8796-42da-ac3d-ee8b7235e907 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.147653 Jul 11 14:08:44.639602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 143/270] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:44 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:45.655766 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:45.656378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:45.662893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:45.663286 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:45.664050 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:45.664486 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:45.797274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:45.805481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2f90a081-ed07-4cee-a0fe-f2e3d49d0001 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.153569 Jul 11 14:08:45.806053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 128/271] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:45 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:46.822258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:46.822889 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:46.829554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:46.830006 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:46.831469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:46.831913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:46.970073 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:46.977533 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fbacd858-5121-4539-bacb-e36a6ff739fe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.159126 Jul 11 14:08:46.978103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 144/272] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:46 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:47.994573 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:47.995212 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:48.001674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:48.002124 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:48.002919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:48.003357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:48.133772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:48.141318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8fbe302b-07cf-4691-a485-802e3408c015 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.150675 Jul 11 14:08:48.141874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 129/273] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:47 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:48.908490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-33930d58-d4f3-4eb2-923d-aae818ebd2e0 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad542b790>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:48.956656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-33930d58-d4f3-4eb2-923d-aae818ebd2e0 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ce1a2ce3-bba0-458d-bbfc-808c529c5eed" status: 200 len: 349 microversion: 2.1 time: 0.052188 Jul 11 14:08:48.957235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 145/274] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:08:48 2022] GET /compute/v2.1/os-volumes/ce1a2ce3-bba0-458d-bbfc-808c529c5eed => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:48.968396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b7f69585-5e8b-4693-8b25-a9d94ccb475b tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad5460550>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.052995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b7f69585-5e8b-4693-8b25-a9d94ccb475b tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.088337 Jul 11 14:08:49.053571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 130/275] 10.222.0.49 () {58 vars in 1133 bytes} [Mon Jul 11 14:08:48 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:49.065504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8c3fa263-e881-4016-875b-c1e7d77550b0 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad542b940>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.150831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8c3fa263-e881-4016-875b-c1e7d77550b0 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.089054 Jul 11 14:08:49.151457 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 146/276] 10.222.0.49 () {58 vars in 1148 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:49.159454 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.160067 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:49.163631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2ef975c7-759e-43b5-a131-8b51a0d8975d tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad536f670>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.166881 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:49.167336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:49.168106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:49.168548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:49.247469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2ef975c7-759e-43b5-a131-8b51a0d8975d tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.087581 Jul 11 14:08:49.248245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 147/277] 10.222.0.49 () {58 vars in 1133 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:08:49.259197 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ef3d2f34-1a89-429d-8efb-a5d45158df75 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad5590430>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.306746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:49.314081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-889d7324-f1ca-4295-8ba3-dac717a22d5e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.159071 Jul 11 14:08:49.314667 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 131/278] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:49.342697 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ef3d2f34-1a89-429d-8efb-a5d45158df75 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087303 Jul 11 14:08:49.343261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 148/279] 10.222.0.49 () {58 vars in 1166 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:08:49.355712 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ecef278b-70f6-4a01-bd7a-b1f08188ae44 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad5405e50>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.568540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ecef278b-70f6-4a01-bd7a-b1f08188ae44 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.217068 Jul 11 14:08:49.569121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 132/280] 10.222.0.49 () {58 vars in 1169 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:49.581262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ca73947d-b47a-4563-a06c-9b37c6e13921 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad542bf70>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.663804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ca73947d-b47a-4563-a06c-9b37c6e13921 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.086675 Jul 11 14:08:49.664514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 149/281] 10.222.0.49 () {58 vars in 1154 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:49.676206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e5baafa4-d017-4bf5-9048-f081942fe4ec tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad54f8160>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.761999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e5baafa4-d017-4bf5-9048-f081942fe4ec tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090129 Jul 11 14:08:49.762855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 133/282] 10.222.0.49 () {58 vars in 1187 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:08:49.774552 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d934fcd7-7ee1-4e7b-ac79-217881a7f804 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] Calling method '.version_select at 0x7ffad536f790>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:49.858180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d934fcd7-7ee1-4e7b-ac79-217881a7f804 tempest-VolumesTestJSON-160973723 tempest-VolumesTestJSON-160973723-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.087503 Jul 11 14:08:49.859028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 150/283] 10.222.0.49 () {58 vars in 1154 bytes} [Mon Jul 11 14:08:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:50.333763 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:50.334294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:50.341821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:50.342266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:50.343046 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:50.343506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:50.475125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:50.483954 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-54d907ab-c76c-43b5-a41b-ae29c733edae tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.155574 Jul 11 14:08:50.484756 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 134/284] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:50 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:51.501738 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:51.502382 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:51.508355 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:51.508812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:51.509564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:51.509988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:51.650131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:51.660107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d99bcda7-85a4-43b7-99db-5fb48a116ffb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.161478 Jul 11 14:08:51.660797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 151/285] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:51 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:52.677923 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:52.678602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:52.685791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:52.686283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:52.687261 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:52.687794 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:52.827210 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:52.835929 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dec7f39c-06e7-404b-96cd-710ceff34b45 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.162879 Jul 11 14:08:52.836669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 135/286] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:52 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:53.869171 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:53.871771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:53.885101 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:53.906391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:53.907366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:53.908720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:53.909239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:53.918244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=85 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:54.243129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:54.252029 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-29eef359-c457-4e50-8854-46bed8fa7694 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.401778 Jul 11 14:08:54.252770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 152/287] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:53 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:55.270123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:55.270947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:55.275989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=42 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:08:55.282625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:55.283313 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:55.284112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:55.284907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:55.447537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:55.462140 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b258906d-a7fd-4f5a-b65f-cb0d4aa29b4c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.195051 Jul 11 14:08:55.464205 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 136/288] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:55 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:56.480683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:56.481279 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:56.488412 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.488851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.489616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.490045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.648996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:56.658292 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c0cbc0c5-65ac-448f-a80c-576d5e159af1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1502 microversion: 2.1 time: 0.181483 Jul 11 14:08:56.658990 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 153/289] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:56 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:56.676361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afe50714-2598-4a9e-ab68-89bf71721360"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:56.678319 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:56.686392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.686846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.687825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.688459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.713861 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] HTTP exception thrown: Cannot 'attach_volume' instance 7d8c2737-675e-4124-86c5-2c06d1d65991 while it is in vm_state rescued Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Request method failure captured: Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/os-volume_attachments HTTP/1.1 Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 74 Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Fsgmr1WTgQMKE5hZq2R64VsT0RCNwaHcoEocjE6DVCgURtIa0Bcl1Q2PVcJyb5htuG_AlChwJobYgN43aTlJwZLRkIhueXYPWK8UtUHtsY5wR57LfgWYKdNGbi-dwY2UFbve_MPkoFxtLHNT1hA3eEMvpjHNo1hoXRH3M7As_Cuc Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:08:56.715615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b181bc391914f6abcea09b894b88473", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b181bc391914f6abcea09b894b88473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}] Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: cf6cc756845148ee8fce9021425cb7cb Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {"volumeAttachment": {"volumeId": "afe50714-2598-4a9e-ab68-89bf71721360"}} Jul 11 14:08:56.717172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Cannot 'attach_volume' instance 7d8c2737-675e-4124-86c5-2c06d1d65991 while it is in vm_state rescued Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'server_id': '7d8c2737-675e-4124-86c5-2c06d1d65991', 'body': {'volumeAttachment': {'volumeId': 'afe50714-2598-4a9e-ab68-89bf71721360'}}} Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:08:56.718008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7d8c2737-675e-4124-86c5-2c06d1d65991 while it is in vm_state rescued Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:08:56.719485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7d8c2737-675e-4124-86c5-2c06d1d65991 while it is in vm_state rescued Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Returning 409 to user: Cannot 'attach_volume' instance 7d8c2737-675e-4124-86c5-2c06d1d65991 while it is in vm_state rescued {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3a04ce51-5c45-4ddb-949c-7afb33436972 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045602 Jul 11 14:08:56.720778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 137/290] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:08:56 2022] POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 14:08:56.727157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:08:56.727771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:56.733943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.734429 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.735475 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.735919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.842212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-16cb734f-8b31-4400-a99a-cf04175e95da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/action" status: 202 len: 0 microversion: 2.1 time: 0.118767 Jul 11 14:08:56.843019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 154/291] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:08:56 2022] POST /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:08:56.857118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:56.859184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:56.867569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.868335 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:56.869218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:56.869665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:57.023260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:57.031480 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-731a62a0-ee11-4e69-b3f8-28d3732d68ba tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1510 microversion: 2.1 time: 0.182881 Jul 11 14:08:57.031908 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 138/292] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:56 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1510 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:58.061284 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:58.064799 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:58.083503 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:58.084139 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:58.085122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:58.085721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:58.306333 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:58.315245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a74e1ff-2d1f-4644-9fc1-f3128c8aede8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1510 microversion: 2.1 time: 0.259292 Jul 11 14:08:58.316532 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 155/293] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:58 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:08:59.333339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:08:59.334757 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:08:59.342799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:59.343552 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:59.344567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:08:59.345309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:08:59.571091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:08:59.583463 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-92d440c4-608d-461b-a605-d102c44673c6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1510 microversion: 2.1 time: 0.254448 Jul 11 14:08:59.584271 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 139/294] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:08:59 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:00.606937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:00.607542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:00.640257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:00.640704 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:00.641670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:00.642395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:00.804232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:00.812751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a57727b8-7ee4-4b17-bfe5-217d0de64a88 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1510 microversion: 2.1 time: 0.209589 Jul 11 14:09:00.813326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 156/295] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:00 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:01.831619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:01.843005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:01.858359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:01.858359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:01.867616 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:01.868073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:02.186292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:02.198426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f55fd89b-25cf-4c5f-b895-a856793ad2fd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1510 microversion: 2.1 time: 0.371513 Jul 11 14:09:02.199160 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 140/296] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:01 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:03.216646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:03.217258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:03.244730 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:03.246068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:03.247261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:03.257272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:03.772309 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:03.786615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f5d266f2-0583-425c-84a2-cfccbfa0d2cd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1516 microversion: 2.1 time: 0.574131 Jul 11 14:09:03.787972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 157/297] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:03 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1516 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:06.281370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5fbd6727-3694-4565-9629-f66cdd469e79 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'create', calling method: .version_select at 0x7ffad5677af0>, body: {"keypair": {"name": "tempest-keypair-498811240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGG+r6++8ok/Zhm9WB81LeABB9qHDDBuDP3dCrVoqUJt8xxFPjwCA3HpNXZtPZo4tgTACg+bGRnFto90X4OseOl04ZL5kX056mgJhdF+eaV9I9CCfxxxnxkJ2dIScHNWg=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:06.299400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-5fbd6727-3694-4565-9629-f66cdd469e79 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for project 4b181bc391914f6abcea09b894b88473. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:09:06.306500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-5fbd6727-3694-4565-9629-f66cdd469e79 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for user cf6cc756845148ee8fce9021425cb7cb and project 4b181bc391914f6abcea09b894b88473. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:09:06.342022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5fbd6727-3694-4565-9629-f66cdd469e79 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064656 Jul 11 14:09:06.369598 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 141/298] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:09:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:06.963745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1594529065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1303563081", "security_groups": [{"name": "tempest-secgroup-smoke-1442611955"}], "networks": [{"uuid": "4020e2d9-bcc8-4ed8-8c6d-106564132adf"}], "block_device_mapping_v2": [{"uuid": "822307a5-3600-42cb-bf24-ea5bce9cfb27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:07.307172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] validate_networks() for [('4020e2d9-bcc8-4ed8-8c6d-106564132adf', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:09:08.131318 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:09:08.132577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:09:08.133965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:09:08.134778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:09:08.135428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:09:08.147343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:08.148198 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:08.149227 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:08.150231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:08.180712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Getting quotas for project 2c01634e004b43239e6912ee0a9d1ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:09:08.186503 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Getting quotas for user e12ac3751780495081b2ef41d13ba360 and project 2c01634e004b43239e6912ee0a9d1ffd. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:09:08.307486 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:09:08.309721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='822307a5-3600-42cb-bf24-ea5bce9cfb27',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:09:08.610334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b0fcf38a-da0a-41c5-9f09-ad511e4259f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.658210 Jul 11 14:09:08.613034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 158/299] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:09:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:09:08.623414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0949cf4f-a65e-402f-b7e1-7c53ee4930ce tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:08.627515 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0949cf4f-a65e-402f-b7e1-7c53ee4930ce tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:08.854937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0949cf4f-a65e-402f-b7e1-7c53ee4930ce tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:08.877483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0949cf4f-a65e-402f-b7e1-7c53ee4930ce tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1089 microversion: 2.1 time: 0.257905 Jul 11 14:09:08.889092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 142/300] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:08 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1089 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:09.769271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-33058568", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c944d348-d5b7-4b6c-9be2-cb2a59820444"}], "security_groups": [{"name": "tempest-securitygroup--577975437"}], "key_name": "tempest-keypair-498811240", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:09.907276 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:09.908658 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:09.928905 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:09.929866 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:09.931039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:09.931649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:09.935937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:09.992068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] validate_networks() for [('c944d348-d5b7-4b6c-9be2-cb2a59820444', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:09:10.063289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:10.090339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-21a2b766-eb9a-45ab-b918-30cea49fc812 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1187 microversion: 2.1 time: 0.186870 Jul 11 14:09:10.107228 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 143/301] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:09 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1187 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:10.864771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:09:10.865725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:09:10.867130 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:09:10.868087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:09:10.868731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:09:10.883643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:10.884095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:10.884987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:10.885399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:10.933538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for project 4b181bc391914f6abcea09b894b88473. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:09:10.945938 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Getting quotas for user cf6cc756845148ee8fce9021425cb7cb and project 4b181bc391914f6abcea09b894b88473. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:09:10.980136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:09:10.986167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:09:11.125560 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eb8b47fc-edb8-44f5-94fc-292c7a0c3dea tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.360288 Jul 11 14:09:11.128316 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 159/302] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:09:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:09:11.142289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bef31ff6-56c9-40c7-864e-a8b543491625 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:11.143732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bef31ff6-56c9-40c7-864e-a8b543491625 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:11.216432 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:11.217500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:11.268812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:11.272273 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:11.275396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:11.278579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:11.405455 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bef31ff6-56c9-40c7-864e-a8b543491625 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:11.447910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bef31ff6-56c9-40c7-864e-a8b543491625 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1243 microversion: 2.1 time: 0.305433 Jul 11 14:09:11.451484 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 144/303] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:11 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1243 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:11.473731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:11.496436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7bce6843-8a12-48a2-b2d1-8d216f962fe6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1205 microversion: 2.1 time: 0.287259 Jul 11 14:09:11.507589 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 160/304] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:11 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1205 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:12.470600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:12.473571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:12.486417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:12.487307 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:12.490136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:12.491411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:12.522550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:12.525857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:12.553135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:12.554720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:12.560233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:12.563627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:12.642651 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:12.658352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ca39d410-c02c-4f0e-b6a4-55f1568727a9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1239 microversion: 2.1 time: 0.193075 Jul 11 14:09:12.668237 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 145/305] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:12 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1239 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:12.895186 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:12.905665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dd527a9a-af04-4ab8-bcc1-1b44157021c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.394814 Jul 11 14:09:12.919271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 161/306] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:12 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:13.701667 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:13.703054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:13.714221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:13.716934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:13.718040 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:13.718769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:13.832938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:13.844287 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5b295c32-5636-44dc-9ee2-fb46ba2098b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1301 microversion: 2.1 time: 0.148381 Jul 11 14:09:13.845376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 146/307] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:13 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1301 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:13.927888 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:13.929512 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:13.955427 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:13.956391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:13.958797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:13.961169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:14.097870 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-9cd82b46-ed4f-4993-84f5-99c6e7f9ee86 req-d873cc8c-abdc-4e5b-9439-b904b75b413e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:14.107572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-9cd82b46-ed4f-4993-84f5-99c6e7f9ee86 req-d873cc8c-abdc-4e5b-9439-b904b75b413e service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:14.108027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-9cd82b46-ed4f-4993-84f5-99c6e7f9ee86 req-d873cc8c-abdc-4e5b-9439-b904b75b413e service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:14.158421 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-9cd82b46-ed4f-4993-84f5-99c6e7f9ee86 req-d873cc8c-abdc-4e5b-9439-b904b75b413e service nova] Creating event network-changed:4376997e-3ed7-4f63-b17e-1d9f27589ff4 for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e on hv-cinder-84842 Jul 11 14:09:14.194649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-9cd82b46-ed4f-4993-84f5-99c6e7f9ee86 req-d873cc8c-abdc-4e5b-9439-b904b75b413e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096225 Jul 11 14:09:14.199799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 147/308] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:09:14.267861 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:14.279192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2d9d7f64-c9c3-408f-b347-bb7c7c660521 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.358217 Jul 11 14:09:14.283015 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 162/309] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:13 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:14.872119 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:14.877958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:14.883978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:14.883978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:14.884718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:14.893963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:15.187988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:15.196641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7f0bb426-a1ad-4cc4-a106-a88d33a8cffe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.329185 Jul 11 14:09:15.199069 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 148/310] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:14 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:15.301129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:15.302492 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:15.318271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:15.320831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:15.324051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:15.326796 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:15.495203 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:15.505424 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9b0df23d-4241-4b1d-ab17-1e7778b8e4fe tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.211565 Jul 11 14:09:15.507161 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 163/311] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:15 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:16.216372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:16.218333 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:16.230750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-de693056-7828-4b0f-94a1-98c1e5b9bf05 req-bab39b98-6777-499c-8dbf-66b8179bebd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0562d881-0ee4-4314-ad52-5a3ab9b17bcf", "tag": "0a982454-2ed0-4dd2-bc29-6243369d5594"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:16.243814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:16.244278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:16.245090 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:16.245537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:16.256035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-de693056-7828-4b0f-94a1-98c1e5b9bf05 req-bab39b98-6777-499c-8dbf-66b8179bebd9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:16.256755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-de693056-7828-4b0f-94a1-98c1e5b9bf05 req-bab39b98-6777-499c-8dbf-66b8179bebd9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:16.269828 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-de693056-7828-4b0f-94a1-98c1e5b9bf05 req-bab39b98-6777-499c-8dbf-66b8179bebd9 service nova] Creating event network-changed:0a982454-2ed0-4dd2-bc29-6243369d5594 for instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf on hv-cinder-84842 Jul 11 14:09:16.279017 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-de693056-7828-4b0f-94a1-98c1e5b9bf05 req-bab39b98-6777-499c-8dbf-66b8179bebd9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052288 Jul 11 14:09:16.280418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 164/312] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:09:16.502594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:16.512235 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bbdbed69-6fc5-42c9-9a5b-6aad7f954f02 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.299768 Jul 11 14:09:16.514345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 149/313] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:16 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:16.524282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:16.527142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:16.537288 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:16.538091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:16.539367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:16.540503 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:16.706900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:16.716885 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e622d004-c5d9-4ebf-886d-d200e6daf954 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.196938 Jul 11 14:09:16.720291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 165/314] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:16 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:17.535085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:17.536821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:17.550021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:17.551680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:17.552682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:17.553278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:17.710785 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:17.728824 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9102fd8e-bd29-4f70-80c7-6ac3e37c544a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.203495 Jul 11 14:09:17.729533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 150/315] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:17 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:17.743588 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:17.745039 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:17.752544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:17.753499 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:17.754714 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:17.755424 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:17.943126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:17.953103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-64521507-d25b-49c6-a0ca-1534985c4593 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.213619 Jul 11 14:09:17.953683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 166/316] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:17 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:18.748040 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:18.748647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:18.757295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:18.758035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:18.759236 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:18.759921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:18.931195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:18.948238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0fe35ca8-ad4f-4f04-b921-08cd6f8617e4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.198243 Jul 11 14:09:18.948238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 151/317] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:18 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:18.971649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:18.972300 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:18.983061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:18.983416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:18.984220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:18.984657 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:19.191733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:19.209838 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d2ef0ef7-e581-4265-9aa9-052fd9cae2b8 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.240455 Jul 11 14:09:19.221460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 167/318] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:18 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:19.979438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:19.980150 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:19.995144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:19.995594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:19.996605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:19.997048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:20.184409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:20.192578 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2150747f-8f07-4e04-996d-ea488fc93d85 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.219362 Jul 11 14:09:20.193317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 152/319] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:19 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:20.228049 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:20.228667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:20.235361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:20.236073 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:20.237071 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:20.237516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:20.406099 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:20.415625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-81fac213-4e6a-46f5-b6ec-99269d9c17d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.191278 Jul 11 14:09:20.416220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 168/320] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:20 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:20.935742 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-416002d2-e40d-487f-b6c0-bd8262745897 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Action: 'create', calling method: .version_select at 0x7ffad5405e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-495506554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsN1yyEqh5oxtV5OrmuAsZ0vZk9vtx0eLAIAOckgTotO/wRAMzNe8CiKNkExuYVgHI6Xaeq6+uha+eIQM7OKLX7JC/Fq4dyUHTgLIn6kXhWgXQpsd6QGi7RBsGWWqSdzg=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:20.954338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-416002d2-e40d-487f-b6c0-bd8262745897 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Getting quotas for project 32353b01d57e434eafdb5f253517ef93. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:09:20.959741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-416002d2-e40d-487f-b6c0-bd8262745897 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Getting quotas for user 365acac78e864078af1a3db4842bc149 and project 32353b01d57e434eafdb5f253517ef93. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:09:20.990614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-416002d2-e40d-487f-b6c0-bd8262745897 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054995 Jul 11 14:09:20.990614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 153/321] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:09:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:21.090366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1959819259", "imageRef": "0ebdb857-1b90-46d7-ab00-d812a61a0eb8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-495506554", "networks": [{"uuid": "6d181705-7d20-4c7e-a599-6ad30727516a"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:21.097590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:21.098251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=12 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:21.141898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] validate_networks() for [('6d181705-7d20-4c7e-a599-6ad30727516a', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:09:21.211200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:21.212240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:21.219679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:21.220138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:21.220985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:21.222801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:21.425354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:21.433254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-72e0484a-2661-4c96-99fa-ab32cefb937f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.227584 Jul 11 14:09:21.433831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 154/322] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:21 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:21.438431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:21.439419 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:21.446771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:21.447096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:21.447878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:21.448314 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:21.661385 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:09:21.662281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:09:21.662913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:09:21.663349 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:09:21.663860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:09:21.666277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:21.674602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:21.674974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1a11a0f6-a752-4644-ad8c-a63b592152b0 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.239517 Jul 11 14:09:21.675107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:21.675574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 155/323] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:21 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:21.675851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:21.676293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:21.695343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Getting quotas for project 32353b01d57e434eafdb5f253517ef93. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:09:21.699668 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Getting quotas for user 365acac78e864078af1a3db4842bc149 and project 32353b01d57e434eafdb5f253517ef93. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:09:21.712145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:09:21.714383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ebdb857-1b90-46d7-ab00-d812a61a0eb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:09:21.764946 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5191ef47-8036-48f2-b5ad-0c37f575f144 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678256 Jul 11 14:09:21.765929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 169/324] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:09:21.776764 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ac716cb5-3014-4d84-9dc2-ef5504e441b4 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:21.777384 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ac716cb5-3014-4d84-9dc2-ef5504e441b4 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:21.846836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ac716cb5-3014-4d84-9dc2-ef5504e441b4 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:21.854750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ac716cb5-3014-4d84-9dc2-ef5504e441b4 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1258 microversion: 2.1 time: 0.082093 Jul 11 14:09:21.855699 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 156/325] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:21 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:22.451138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:22.451910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:22.459233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:22.459528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:22.460287 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:22.460717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:22.475682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:22.605869 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:22.613367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a1d2d6a5-fde9-4b58-8dd5-bd7bfa5464f1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.166348 Jul 11 14:09:22.614018 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 170/326] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:22 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:22.692399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:22.693002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:22.699517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:22.699976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:22.700718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:22.701149 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:22.848639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:22.859714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-05fa6919-e14d-4ca3-ac54-316e70799083 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.171090 Jul 11 14:09:22.861487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 157/327] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:22 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:22.876815 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:22.878052 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:22.886817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:22.887312 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:22.888075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:22.888504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:22.962458 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:22.971060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a5c1cccd-0083-420c-a978-ca5403945bb9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1254 microversion: 2.1 time: 0.098470 Jul 11 14:09:22.971883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 171/328] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:22 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1254 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:22.989151 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-01115459-bcc7-484a-a570-9f9e4f97674d req-736bdaf6-b01b-49b1-b472-39ce190cd890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0562d881-0ee4-4314-ad52-5a3ab9b17bcf", "name": "network-vif-plugged", "status": "completed", "tag": "0a982454-2ed0-4dd2-bc29-6243369d5594"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:23.000871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-01115459-bcc7-484a-a570-9f9e4f97674d req-736bdaf6-b01b-49b1-b472-39ce190cd890 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.001763 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-01115459-bcc7-484a-a570-9f9e4f97674d req-736bdaf6-b01b-49b1-b472-39ce190cd890 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:23.015316 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-01115459-bcc7-484a-a570-9f9e4f97674d req-736bdaf6-b01b-49b1-b472-39ce190cd890 service nova] Creating event network-vif-plugged:0a982454-2ed0-4dd2-bc29-6243369d5594 for instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf on hv-cinder-84842 Jul 11 14:09:23.021520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-01115459-bcc7-484a-a570-9f9e4f97674d req-736bdaf6-b01b-49b1-b472-39ce190cd890 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036850 Jul 11 14:09:23.022203 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 158/329] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:09:23.629455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:23.629987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:23.635993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.636441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:23.637196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.637630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:23.765417 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:23.772934 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0789e248-9020-4076-ba71-a12d2a84ef63 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.147377 Jul 11 14:09:23.773509 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 172/330] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:23 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:23.878462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:23.879159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:23.885888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.886270 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:23.887059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.887493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:23.988975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:23.989588 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:23.995719 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.996163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:23.996931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:23.997366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:24.283252 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:24.290964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-746fb78c-55eb-4289-b0af-9cd98b2616c4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.416661 Jul 11 14:09:24.291642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 159/331] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:23 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:24.301044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:24.309461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4d02cbc8-ec3e-47a7-baaa-d020001b2b41 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1310 microversion: 2.1 time: 0.324368 Jul 11 14:09:24.310024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 173/332] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:23 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1310 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:24.789651 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:24.790270 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:24.796384 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:24.796885 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:24.797821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:24.798338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:24.937052 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:24.951860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2daade06-0c00-4a02-80c7-7948251385fb tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.165964 Jul 11 14:09:24.952602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 160/333] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:24 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:25.308688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:25.309401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:25.311818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:25.319132 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:25.319757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:25.320536 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:25.320980 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:25.327228 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:25.328179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:25.331454 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:25.335731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:25.336182 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:25.336985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:25.337430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:25.428902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:25.436733 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d0ce809f-a43c-4a09-acb9-b5d40f37fe46 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1310 microversion: 2.1 time: 0.113730 Jul 11 14:09:25.437696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 161/334] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:25 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1310 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:25.516156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:25.524310 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-98a0afe8-8650-4f0b-a36b-d0793a42b3a4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.219553 Jul 11 14:09:25.524887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 174/335] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:25 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:25.969153 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:25.969775 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:25.976893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:25.977336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:25.978125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:25.978556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:26.127045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:26.140112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-65abac15-98b9-4031-a5bd-2504336b4a0d tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.174325 Jul 11 14:09:26.140706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 162/336] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:25 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:26.453748 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:26.454382 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:26.460739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:26.461191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:26.461972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:26.462451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:26.528448 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:26.537121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fea6ac5a-a97c-41d0-a1b3-8272e9b04874 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1310 microversion: 2.1 time: 0.087132 Jul 11 14:09:26.537716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 175/337] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:26 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:26.546132 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:26.546536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:26.554205 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:26.554683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:26.555462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:26.555893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:26.715571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:26.724453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cc74ea06-f49d-443c-a19a-991ad79ee680 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.182560 Jul 11 14:09:26.725039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 163/338] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:26 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:27.160750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:27.161983 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:27.172535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:27.173375 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:27.174815 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:27.176093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:27.399710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:27.407566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a068c27f-9996-4f1e-a54a-739ec39e31da tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.253410 Jul 11 14:09:27.411414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 176/339] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:27 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:27.555537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:27.556213 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:27.562885 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:27.563336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:27.564195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:27.564881 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:27.568009 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:27.634020 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:27.641848 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5238c9ef-22f7-40a1-bb7a-3847f7006fec tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1316 microversion: 2.1 time: 0.091864 Jul 11 14:09:27.642454 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 164/340] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:27 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:27.741531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:27.742204 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:27.748465 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:27.748915 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:27.749687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:27.750126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:27.889254 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:27.897613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-895fe943-ecb5-4962-99ae-c742b66cff43 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.159893 Jul 11 14:09:27.898198 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 177/341] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:27 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:28.425913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:28.426866 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:28.438185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:28.441124 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:28.441979 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:28.445645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:28.666202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:28.668482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:28.684208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:28.691885 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:28.692788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:28.694619 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:28.695074 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:28.702691 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1b32cd50-4ed5-4ea9-b3cf-450fa54c29b5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.281301 Jul 11 14:09:28.722790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 165/342] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:28 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:28.921234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:28.921921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:28.931240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:28.931948 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:28.933061 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:28.933804 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:28.938488 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:28.949273 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f35897c6-5fbf-43a3-95bc-ab2ff76d0822 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.293484 Jul 11 14:09:28.954427 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 178/343] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:28 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:29.119887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:29.130237 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-539063b5-8e56-4a6c-b5cd-53989ee143f7 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.214851 Jul 11 14:09:29.130879 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 166/344] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:28 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:29.391510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-2c987a5f-b355-49a8-a2b1-3add581aae4d req-fc243696-dee3-46a5-bb95-4acc23b23c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "name": "network-vif-plugged", "status": "completed", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:29.419480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-2c987a5f-b355-49a8-a2b1-3add581aae4d req-fc243696-dee3-46a5-bb95-4acc23b23c64 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:29.420563 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-2c987a5f-b355-49a8-a2b1-3add581aae4d req-fc243696-dee3-46a5-bb95-4acc23b23c64 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:29.435318 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-2c987a5f-b355-49a8-a2b1-3add581aae4d req-fc243696-dee3-46a5-bb95-4acc23b23c64 service nova] Creating event network-vif-plugged:4376997e-3ed7-4f63-b17e-1d9f27589ff4 for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e on hv-cinder-84842 Jul 11 14:09:29.441140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-2c987a5f-b355-49a8-a2b1-3add581aae4d req-fc243696-dee3-46a5-bb95-4acc23b23c64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053185 Jul 11 14:09:29.441762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 179/345] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:09:29.721558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:29.722556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:29.745890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:29.746465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:29.747611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:29.748171 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:29.953667 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:29.967885 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-575f31ec-4e56-4300-92fd-d3625db337b6 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.249683 Jul 11 14:09:29.969180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 167/346] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:29 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:29.969873 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:29.971200 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:29.982781 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:29.983596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:29.984961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:29.985729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:30.144557 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:30.152762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3c5f22c5-e3b6-4599-9604-2a33a4a0e770 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.188777 Jul 11 14:09:30.153336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 180/347] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:29 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:30.153532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:30.154379 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:30.161924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:30.162411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:30.163204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:30.163652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:30.347568 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:30.355611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-17af1521-2768-4f0b-8387-d2586a6d5691 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.208824 Jul 11 14:09:30.356200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 168/348] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:30 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:30.993787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:30.994417 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:31.000492 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:31.000936 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:31.001717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:31.002154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:31.170934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:31.172927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:31.180665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:31.181388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:31.182174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:31.182932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:31.210463 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:31.221336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4c9f4963-9ea3-4b82-b4ea-fe0653483e96 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.231349 Jul 11 14:09:31.223080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 181/349] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:30 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:31.383149 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:31.385115 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:31.400441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:31.401601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:31.403389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:31.404731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:31.457854 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:31.467499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a59d3145-f5b0-4962-a082-c4fb77cf5afe tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.301176 Jul 11 14:09:31.478993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 169/350] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:31 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:31.636364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:31.645301 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5fddc27e-a55b-4002-b456-8333991b21c6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.271995 Jul 11 14:09:31.646743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 182/351] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:31 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:32.247062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:32.247892 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:32.251078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=14 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:32.263238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:32.264700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:32.265556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:32.266005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:32.471030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:32.483152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-992dadef-9a6e-4f9f-890f-ab85342752aa tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.241198 Jul 11 14:09:32.484279 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 170/352] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:32 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:32.493585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:32.493585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:32.493585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:32.493585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:32.498723 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:32.498723 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:32.498723 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:32.498977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:32.664967 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:32.665254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:32.665706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:32.672702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:32.673467 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:32.674665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:32.675425 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:32.695574 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-301ba728-cd92-47d1-ae67-68fb25edddd0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.214006 Jul 11 14:09:32.696589 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 183/353] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:32 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:32.830961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:32.863656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b0bd729f-09c0-4df2-ae60-ba6206fb57ea tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.202174 Jul 11 14:09:32.864571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 171/354] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:32 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:33.501481 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:33.503559 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:33.509809 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:33.510838 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:33.511961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:33.512774 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:33.677220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:33.685178 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-66ef3818-dcf1-4e03-b350-98bc3c24b4bc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.187621 Jul 11 14:09:33.686613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 184/355] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:33 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:33.714044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:33.714830 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:33.722619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:33.723150 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:33.723992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:33.724492 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:33.894631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:33.895522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:33.906718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:33.912919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:33.914006 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:33.915604 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d3cf193c-6ba9-4b4d-91b0-59202aeef79f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.206047 Jul 11 14:09:33.916098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 172/356] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:33 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:33.916761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:33.917203 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:34.101006 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:34.112005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b4434515-1579-45dd-9eb6-176597cae140 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.221415 Jul 11 14:09:34.113416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 185/357] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:33 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:34.704713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:34.705788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:34.726063 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:34.726783 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:34.727349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:34.727792 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:34.886087 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:34.894550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-10e72511-d83a-4f6c-9451-c51c639236b8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.194454 Jul 11 14:09:34.895134 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 173/358] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:34 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:34.933634 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:34.934859 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:34.942556 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:34.943232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:34.944160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:34.944732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:35.083694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:35.094139 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2a5248f5-bafe-4b65-9050-c2a36959c44a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.164201 Jul 11 14:09:35.095042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 186/359] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:34 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:35.137846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:35.138643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:35.145778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:35.146221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:35.147014 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:35.147445 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:35.299680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:35.320590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-572b24e6-8d1e-4994-b084-c49ab5d26961 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.186152 Jul 11 14:09:35.322195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 174/360] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:35 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:35.913504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:35.914118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:35.920310 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:35.920755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:35.921530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:35.921967 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:36.064671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:36.067157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:36.079665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-30033ee6-1bcd-4919-90ab-6814fb6e6449 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.170114 Jul 11 14:09:36.082482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 187/361] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:35 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:36.112831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:36.113497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:36.119492 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:36.119932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:36.120690 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:36.121185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:36.258114 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:36.265946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-25069fdb-8c3a-40b9-9545-f6ebd8fb8560 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.157041 Jul 11 14:09:36.266592 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 175/362] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:36 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:36.340739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:36.341340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:36.347595 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:36.348048 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:36.348816 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:36.349267 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:36.501477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:36.510678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-50105ad5-b248-454f-acbf-22402766d1a1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.174182 Jul 11 14:09:36.521824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 188/363] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:36 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:37.099321 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:37.100073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:37.106857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:37.107515 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:37.108350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:37.108854 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:37.261159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:37.285276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:37.285955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:37.288652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-17d9b3e3-dd49-4158-9505-175f154e72a3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.193625 Jul 11 14:09:37.289292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 176/364] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:37 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:37.303034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:37.303752 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:37.305051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:37.305778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:37.535520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:37.536513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:37.552669 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:37.554488 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:37.555723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:37.557156 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:37.557946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:37.561238 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-664ac972-6049-40d5-bcd1-1f80e26521ca tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.280880 Jul 11 14:09:37.561825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 189/365] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:37 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:37.791088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:37.808114 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-12cfa545-bd74-4bad-82db-158eb4fdf4c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.282227 Jul 11 14:09:37.809871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 177/366] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:37 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:38.306666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:38.307403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:38.314140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:38.314625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:38.315990 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:38.316434 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:38.498622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:38.507574 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9740ac9b-3f26-4bc4-9756-909914067a76 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.204900 Jul 11 14:09:38.508502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 190/367] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:38 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:38.578816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:38.580389 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:38.589875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:38.591170 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:38.592181 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:38.592976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:38.816697 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:38.829991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:38.831131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:38.842860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:38.843413 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:38.844263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:38.844715 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:38.845844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1026bbd3-ebc8-44e6-8027-821a589b9c89 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.270773 Jul 11 14:09:38.847806 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 178/368] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:38 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:39.023677 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:39.032128 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f8c41d1d-2682-4b76-af08-fc2bccc9fb65 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.209276 Jul 11 14:09:39.032909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 191/369] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:38 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:39.528232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:39.529677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:39.539381 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:39.540102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:39.541041 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:39.541627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:39.739205 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:39.747340 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-eee24271-b85a-46c5-bfba-b209656a4e78 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.225597 Jul 11 14:09:39.747931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 179/370] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:39 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:39.869621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:39.871530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:39.879862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:39.880314 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:39.881489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:39.882119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:40.055036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:40.057175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:40.068797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:40.071998 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:40.078857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:40.079834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:40.080381 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:40.084560 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d740768a-3db7-4d72-81d6-e1ac3dcac4f0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.219166 Jul 11 14:09:40.087080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 192/371] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:39 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:40.276892 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:40.279923 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:40.291169 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9a49996c-bedc-4ee9-8fb9-a177dd91e58e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.243798 Jul 11 14:09:40.292628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 180/372] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:40 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:40.766236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:40.767391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:40.778389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:40.779191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:40.780616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:40.781390 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:40.985925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:40.994514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-40d37aad-799a-403c-b6c2-126574be0985 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.232742 Jul 11 14:09:40.995321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 193/373] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:40 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:41.108146 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:41.109110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:41.120928 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:41.121681 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:41.123104 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:41.123875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:41.311441 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:41.313067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:41.313711 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:41.320966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:41.321411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:41.322429 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:41.322854 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:41.323633 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-35e79c8b-d11b-439c-b9ee-821be846a57f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.223207 Jul 11 14:09:41.324219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 181/374] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:41 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:41.480638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:41.489608 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f9a97902-a1f6-401a-ab50-f5df1dd5ea2a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.181274 Jul 11 14:09:41.490568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 194/375] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:41 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:42.020559 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:42.021173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:42.027468 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:42.027912 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:42.028687 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:42.029121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:42.207256 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:42.215917 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-972c39e7-049d-4b57-acc0-d47c0ccad086 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.199819 Jul 11 14:09:42.216840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 182/376] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:42 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:42.340971 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:42.341655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:42.348166 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:42.348622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:42.349407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:42.349849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:42.502157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:42.511660 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1460d29e-e4d8-4b6d-aad8-d9ae7d95e27d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.174744 Jul 11 14:09:42.523123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 195/377] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:42 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:42.530426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:42.531753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:42.539927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:42.540381 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:42.541169 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:42.541611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:42.713481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:42.723943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3e9170b1-fa39-4a25-abc1-044894c9e6db tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.210760 Jul 11 14:09:42.724810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 183/378] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:42 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:43.233104 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:43.233634 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:43.239871 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:43.240323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:43.241101 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:43.241542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:43.380706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:43.388305 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-79798ecf-6097-48d6-bbc1-0360e78f505f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.159103 Jul 11 14:09:43.388888 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 196/379] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:43 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:43.529277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:43.529912 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:43.537619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:43.538340 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:43.539028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:43.539556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:43.692385 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:43.702246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d6fbd1d7-3ade-45b1-8ab3-20930f77fe43 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.176870 Jul 11 14:09:43.702868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 184/380] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:43 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:43.742132 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:43.742741 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:43.748987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:43.749422 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:43.750180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:43.750643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:43.902550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:43.910803 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-32a7a62b-48cc-4471-b2e9-07f8b7ddf092 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.172415 Jul 11 14:09:43.911383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 197/381] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:43 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:44.409565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:44.410192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:44.416464 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:44.416908 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:44.417686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:44.418118 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:44.557580 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:44.574394 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-93184624-e8a7-4acd-8178-21340790fd99 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1368 microversion: 2.1 time: 0.171514 Jul 11 14:09:44.575787 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 185/382] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:44 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:44.723776 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:44.725962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:44.740585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:44.741770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:44.743432 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:44.744447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:44.928991 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:44.929995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:44.938919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:44.940394 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:44.941477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:44.941986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:44.946941 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:44.961729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6e277010-650a-4aef-9ffb-3a21d5fc93cc tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.246091 Jul 11 14:09:44.966290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 198/383] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:44 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:45.122478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:45.138937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f7cc3231-11f0-4ce5-9c9e-1020c67f62dd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.215269 Jul 11 14:09:45.139567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 186/384] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:44 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:45.380383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-84d836c9-e8b1-49c6-bed2-846d162f0e2f req-c96f8b9d-b22f-4cc1-812e-a612b52b44c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:45.391251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-84d836c9-e8b1-49c6-bed2-846d162f0e2f req-c96f8b9d-b22f-4cc1-812e-a612b52b44c9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.391970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-84d836c9-e8b1-49c6-bed2-846d162f0e2f req-c96f8b9d-b22f-4cc1-812e-a612b52b44c9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:45.404657 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-84d836c9-e8b1-49c6-bed2-846d162f0e2f req-c96f8b9d-b22f-4cc1-812e-a612b52b44c9 service nova] Creating event network-changed:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:09:45.412152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-84d836c9-e8b1-49c6-bed2-846d162f0e2f req-c96f8b9d-b22f-4cc1-812e-a612b52b44c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035438 Jul 11 14:09:45.413846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 199/385] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:45.592924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:45.593639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:45.600769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.601211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:45.601968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.602436 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:45.733863 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:45.741679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2c8a2bc7-7b8f-4962-b6ca-0b9fdf0be0ad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1563 microversion: 2.1 time: 0.152530 Jul 11 14:09:45.742253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 187/386] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:45 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:45.759773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:45.759773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:45.766113 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.766590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:45.767361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.767794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:45.852561 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3a9c82d3-b05b-4d78-b82f-2b0d029876bd tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097816 Jul 11 14:09:45.853165 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 200/387] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:09:45 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:45.984247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:45.984952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:45.992247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.992689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:45.993458 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:45.993887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:46.160898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:46.162192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:46.173094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:46.174042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:46.175674 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:46.177635 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:46.301232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:46.316999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-792adfdf-eb4c-44df-baa7-d724fe060e2a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.336736 Jul 11 14:09:46.328387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 188/388] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:45 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:46.522972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:46.534460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-238253e7-64ec-414f-a29a-c1e066c4fd45 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1261 microversion: 2.1 time: 0.380885 Jul 11 14:09:46.543640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 201/389] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:46 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1261 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:47.073700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8dc19972-377e-4d74-a21b-2624adf96a7b req-09994de4-36d9-4c6b-a394-12b91221a9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0562d881-0ee4-4314-ad52-5a3ab9b17bcf", "tag": "0a982454-2ed0-4dd2-bc29-6243369d5594"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:47.083262 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8dc19972-377e-4d74-a21b-2624adf96a7b req-09994de4-36d9-4c6b-a394-12b91221a9ab service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.083782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8dc19972-377e-4d74-a21b-2624adf96a7b req-09994de4-36d9-4c6b-a394-12b91221a9ab service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.097775 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8dc19972-377e-4d74-a21b-2624adf96a7b req-09994de4-36d9-4c6b-a394-12b91221a9ab service nova] Creating event network-changed:0a982454-2ed0-4dd2-bc29-6243369d5594 for instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf on hv-cinder-84842 Jul 11 14:09:47.104139 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8dc19972-377e-4d74-a21b-2624adf96a7b req-09994de4-36d9-4c6b-a394-12b91221a9ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033813 Jul 11 14:09:47.104765 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 189/390] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:47.339964 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:47.340486 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:47.347061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.347744 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.348504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.348932 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.489334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:47.497969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a2fab878-ea93-4c99-8df7-54d683357856 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.161688 Jul 11 14:09:47.499063 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 202/391] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:47 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:47.553897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:47.554889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:47.564061 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.565448 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.566517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.567167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.735528 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:47.755230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-271e9fe8-30d2-4d3e-8bfc-09ac327e2880 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1445 microversion: 2.1 time: 0.206372 Jul 11 14:09:47.755230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 190/392] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:47 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1445 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:47.771765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:47.772790 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:47.780366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.787195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.791079 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:47.791576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:47.965549 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:47.976447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-243eb821-ca84-4385-a3a2-721dafadd53b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1445 microversion: 2.1 time: 0.208478 Jul 11 14:09:47.977444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 203/393] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:47 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1445 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:48.515513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:48.516128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:48.523554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:48.524003 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:48.524996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:48.525436 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:48.874479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:48.883322 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e8ff6b6e-52bb-4660-b79f-83604c15ae0e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.371600 Jul 11 14:09:48.884347 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 191/394] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:48 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:49.902933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:49.903566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:49.912560 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:49.916397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:49.917330 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:49.917853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:50.178496 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:50.189517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ef5bb025-6168-4455-a51e-c956d315c521 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.292611 Jul 11 14:09:50.190135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 204/395] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:49 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:50.475772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-43d81cc2-aad6-4963-a62b-4585feb5d498 req-5cf938a2-79f0-4415-84fa-8ad48e5225e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:50.487042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-43d81cc2-aad6-4963-a62b-4585feb5d498 req-5cf938a2-79f0-4415-84fa-8ad48e5225e1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:50.487840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-43d81cc2-aad6-4963-a62b-4585feb5d498 req-5cf938a2-79f0-4415-84fa-8ad48e5225e1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:50.499342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-43d81cc2-aad6-4963-a62b-4585feb5d498 req-5cf938a2-79f0-4415-84fa-8ad48e5225e1 service nova] Creating event network-changed:4376997e-3ed7-4f63-b17e-1d9f27589ff4 for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e on hv-cinder-84842 Jul 11 14:09:50.505083 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-43d81cc2-aad6-4963-a62b-4585feb5d498 req-5cf938a2-79f0-4415-84fa-8ad48e5225e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034110 Jul 11 14:09:50.506141 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 192/396] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:09:51.210192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:51.210929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:51.220163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:51.221762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:51.222664 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:51.223108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:51.247036 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:51.384786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:51.393716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e8deb675-9781-49b4-b7e6-3bcb29655b71 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.189399 Jul 11 14:09:51.394630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 205/397] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:51 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:52.411411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:52.412097 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:52.418518 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:52.418968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:52.419720 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:52.420148 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:52.555132 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:52.562628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e379cbd3-b5c2-4782-a312-c6006eb9c00e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.155881 Jul 11 14:09:52.563202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 193/398] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:52 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:53.579276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:53.579887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:53.587121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:53.587567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:53.588418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:53.588884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:53.729154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:53.737616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dd06b89f-ade1-4ca2-8cf8-d5d36b2fb882 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.162328 Jul 11 14:09:53.738188 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 206/399] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:53 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:54.755834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:54.756698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:54.763191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:54.763649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:54.764417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:54.764857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:54.904968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:54.913951 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9ab0cdb0-3c02-4300-9e09-77c89f78e374 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.162508 Jul 11 14:09:54.914699 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 194/400] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:54 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:55.737111 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-a4f9d3dd-a50a-44af-9153-d08e30e70f68 req-8fa79bf0-cded-4492-bcd2-20045f554aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "name": "network-vif-plugged", "status": "completed", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:09:55.746350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=66 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:55.755317 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a4f9d3dd-a50a-44af-9153-d08e30e70f68 req-8fa79bf0-cded-4492-bcd2-20045f554aad service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:55.755749 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a4f9d3dd-a50a-44af-9153-d08e30e70f68 req-8fa79bf0-cded-4492-bcd2-20045f554aad service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:55.769488 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-a4f9d3dd-a50a-44af-9153-d08e30e70f68 req-8fa79bf0-cded-4492-bcd2-20045f554aad service nova] Creating event network-vif-plugged:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:09:55.776159 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-a4f9d3dd-a50a-44af-9153-d08e30e70f68 req-8fa79bf0-cded-4492-bcd2-20045f554aad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044297 Jul 11 14:09:55.777936 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 207/401] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:55.938958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:55.940723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:55.947180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=68 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:55.960108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:55.960791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:55.962081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:55.962559 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:56.172715 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:56.182282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5e0773b5-962d-4039-8f47-34f985ce8da9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.248390 Jul 11 14:09:56.182442 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 195/402] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:55 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:09:57.198166 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:57.198899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:57.205421 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:57.205865 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:57.206665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:57.207213 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:57.349658 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:57.357282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b1f4e9b5-2a16-4622-8e79-ef33fa53caa3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1358 microversion: 2.1 time: 0.163257 Jul 11 14:09:57.357871 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 208/403] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:57 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:58.374786 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:58.375334 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:58.381914 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.382408 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.383167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.383606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.514678 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:58.522680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6ff97d85-0f2f-4240-82a3-1795b9a2266e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1546 microversion: 2.1 time: 0.151925 Jul 11 14:09:58.523283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 196/404] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:58 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:58.539725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:58.540361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:58.546410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.546861 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.547623 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.548055 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.695896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:58.704115 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6774cac8-90d0-488b-83d9-880819efb33c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1546 microversion: 2.1 time: 0.168175 Jul 11 14:09:58.716068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 209/405] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:58 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:09:58.721391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:58.725253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:58.727318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Searching by: {'deleted': False, 'project_id': '32353b01d57e434eafdb5f253517ef93'} {{(pid=117980) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 11 14:09:58.740346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.740924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.742373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.742827 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.839647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.multi_cell_list [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117980) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 11 14:09:58.944337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2d95159f-688c-461a-a6bb-ae9c629476c3 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227471 Jul 11 14:09:58.944922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 197/406] 10.222.0.49 () {58 vars in 1124 bytes} [Mon Jul 11 14:09:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:09:58.956410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:09:58.957309 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:09:58.963483 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.963927 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:58.964693 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:09:58.965303 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:09:59.100149 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:09:59.107657 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b5d0cc30-97c3-4a01-b106-fd96d61dd877 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1546 microversion: 2.1 time: 0.155688 Jul 11 14:09:59.108236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 210/407] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:09:58 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:00.652684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55179916-ff43-4924-b451-2981649a7293"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:00.653737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:00.660430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:00.660872 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:00.661623 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:00.662052 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:00.679671 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:00.953307 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9d0d0d6d-fdeb-400b-bc8b-16e7d9e92bf1 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304271 Jul 11 14:10:00.953974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 198/408] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:10:00 2022] POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:01.653737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:01.654219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:01.660335 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:01.660787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:01.661554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:01.661992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:01.685516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ca20c95b-39b5-4257-9c68-7fe991820d56 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/ips" status: 200 len: 150 microversion: 2.1 time: 0.035614 Jul 11 14:10:01.686097 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 211/409] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:10:01 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:05.550081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:05.550762 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:05.557156 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:05.557603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:05.558387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:05.558826 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:05.582410 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-171e2665-b147-4e4c-9050-f08abb446969 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/ips" status: 200 len: 151 microversion: 2.20 time: 0.037270 Jul 11 14:10:05.582975 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 199/410] 10.222.0.49 () {60 vars in 1288 bytes} [Mon Jul 11 14:10:05 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:10:06.096349 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:06.096901 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:06.103350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:06.103751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:06.104776 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:06.104988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:06.128849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a8738b6f-efdd-47d8-ae54-5ccb5d7d42e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/ips" status: 200 len: 145 microversion: 2.1 time: 0.036910 Jul 11 14:10:06.129420 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 212/411] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:10:06 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:06.202615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:06.203829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:06.211030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:06.211477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:06.212251 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:06.212687 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:06.520272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5be6d334-c951-46d8-882a-4b8459c46df4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321533 Jul 11 14:10:06.520887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 200/412] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:10:06 2022] POST /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:08.530060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:08.530671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:08.537295 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:08.537745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:08.538555 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:08.538998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:08.564185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lazy-loading 'flavor' on Instance uuid 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:10:08.875051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-27abe6c4-9ae4-43bc-9e0e-ec7c9a822a7d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/action" status: 202 len: 0 microversion: 2.20 time: 0.348648 Jul 11 14:10:08.875919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 213/413] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 11 14:10:08 2022] POST /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:10:08.882184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:08.887142 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:08.887856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:08.895588 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:08.895992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:08.896772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:08.897349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:09.034788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:09.042840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:09.044339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:09.045489 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-23c2cd56-27b7-4271-bcc2-a568dfc3a6a3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.164821 Jul 11 14:10:09.046055 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 201/414] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:08 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:10.066061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:10.066831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:10.073655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:10.074126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:10.075067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:10.075565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:10.223049 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:10.232594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:10.234118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:10.235347 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a6c258e6-ba6d-401f-a5da-fee2ece25970 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.174207 Jul 11 14:10:10.235962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 214/415] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:10 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:11.258128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:11.258820 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:11.265429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:11.265881 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:11.266690 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:11.267663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:11.400965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:11.409756 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:11.411274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:11.412435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ab6b464b-025a-4c94-885a-4a43f0bbc77b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.158256 Jul 11 14:10:11.413281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 202/416] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:11 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:12.431518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:12.432132 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:12.438076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:12.438569 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:12.439336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:12.439775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:12.568780 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:12.577100 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:12.578630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:12.579790 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-962b89f8-af9e-4b95-8415-5b4f5b468cdf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.152185 Jul 11 14:10:12.580342 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 215/417] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:12 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:13.598692 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:13.599230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:13.605649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:13.606096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:13.606889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:13.607316 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:13.735689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:13.743540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:13.745048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:13.746193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8016787a-0766-428e-955e-6e3928df0f7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.152067 Jul 11 14:10:13.746782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 203/418] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:13 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:14.764848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:14.765484 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:14.771408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:14.771860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:14.772621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:14.773060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:14.916281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:14.925359 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:14.927244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:14.928480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6757f970-3d46-470f-ae8b-18e7deb84b79 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.167546 Jul 11 14:10:14.929115 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 216/419] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:14 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:15.078427 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bacfad8-c19a-46d4-9993-6d1ce9e8c59e"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:15.079165 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:15.089171 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:15.089171 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:15.089705 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:15.090111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:15.356845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ce1db7fe-3ec4-406a-a38b-49225811a39c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282588 Jul 11 14:10:15.357481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 204/420] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:10:15 2022] POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:15.948133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:15.948795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:15.955329 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:15.955709 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:15.956500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:15.956932 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:16.093755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:16.101978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:16.103534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:16.104700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-32274188-42b0-4622-9834-b328085f56cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.160511 Jul 11 14:10:16.105266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 217/421] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:15 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:17.124169 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:17.124960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:17.131217 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:17.131657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:17.132405 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:17.132856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:17.263739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:17.272567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:17.274084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:17.275288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-691f09d9-ee59-4d9d-bd6e-657134f404d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.156130 Jul 11 14:10:17.275855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 205/422] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:17 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:18.293970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:18.294616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:18.301497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:18.301947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:18.302734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:18.303177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:18.428099 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:18.435971 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:18.437459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:18.438619 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-097f7f0a-6e4d-467d-909d-5a1c0bf51e3a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.148504 Jul 11 14:10:18.439177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 218/423] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:18 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:19.456681 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:19.457223 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:19.463936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:19.464392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:19.465180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:19.465621 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:19.592699 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:19.601413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:19.602942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:19.604103 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e3196f48-048e-44ea-bc0c-0513a087786b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.151412 Jul 11 14:10:19.604889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 206/424] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:19 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:20.622279 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:20.622899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:20.629890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:20.630340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:20.631120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:20.631559 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:20.767152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:20.776019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:20.777525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:20.778717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-849d8deb-decc-4790-9a8e-49e7c50d3a7b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.160365 Jul 11 14:10:20.779281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 219/425] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:20 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:21.796996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:21.797615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:21.804296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:21.804738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:21.805481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:21.805911 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:21.938080 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:21.946216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:21.947705 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:21.948859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-550db40e-6426-4589-b55e-c072c60fe12e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.155820 Jul 11 14:10:21.949425 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 207/426] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:21 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:22.967995 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:22.968638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:22.976227 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:22.976680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:22.977455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:22.977898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:22.982109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:23.119649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:23.128301 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:23.129747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:23.130942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2c54b9f4-dba9-4507-ac24-4863b127dc3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.167058 Jul 11 14:10:23.131709 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 220/427] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:22 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:23.531913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:23.532532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:23.538950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:23.539656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:23.540438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:23.540879 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:23.682515 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:23.690999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7c7597ba-1d54-434c-9e7b-201d2cbfb578 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1592 microversion: 2.1 time: 0.162995 Jul 11 14:10:23.691569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 208/428] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:23 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1592 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:24.151046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:24.151667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:24.157575 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:24.158023 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:24.158818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:24.159251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:24.346835 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:24.354899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:24.356444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:24.357639 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d1107f57-bfa4-43c0-80b5-d85bbeb2c0a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.210613 Jul 11 14:10:24.358214 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 221/429] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:24 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:25.363397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:10:25.363941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:10:25.377116 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:25.377814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:25.384552 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:25.385109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:25.385973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:25.386420 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:25.633304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:25.645130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:25.646512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:25.647687 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4134afb3-5bee-4ba2-bfcc-56fdd03d462c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.274350 Jul 11 14:10:25.648265 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 209/430] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:25 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:25.872945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-1922d8b5-c9bf-4e95-8d1c-dd660c76eeb4 req-29d42f8d-bf0a-420e-93af-876a8b8b7be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:25.883406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-1922d8b5-c9bf-4e95-8d1c-dd660c76eeb4 req-29d42f8d-bf0a-420e-93af-876a8b8b7be2 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:25.883957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-1922d8b5-c9bf-4e95-8d1c-dd660c76eeb4 req-29d42f8d-bf0a-420e-93af-876a8b8b7be2 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:25.896630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-1922d8b5-c9bf-4e95-8d1c-dd660c76eeb4 req-29d42f8d-bf0a-420e-93af-876a8b8b7be2 service nova] Creating event network-changed:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:10:25.903336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-1922d8b5-c9bf-4e95-8d1c-dd660c76eeb4 req-29d42f8d-bf0a-420e-93af-876a8b8b7be2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035131 Jul 11 14:10:25.919219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 222/431] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:10:26.666570 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:26.667188 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:26.669913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=30 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:26.676056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:26.677121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:26.677926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:26.678396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:26.873276 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:26.884617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:26.886177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:26.887512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-62425d83-e0a2-4198-adba-b0e60e0cf40c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.224686 Jul 11 14:10:26.888179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 210/432] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:26 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:27.268911 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-25450280"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:27.269526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:27.271708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=32 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:27.277530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:27.277981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:27.278787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:27.279219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:27.424708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.network.security_group_api [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Adding security group fdea2c5a-b313-418d-8a38-0ec70ae96512 to port 1a67ea54-5ffe-4602-930f-febfe4f1c871 Jul 11 14:10:27.913760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:27.915540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:27.931637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f6e5e4b1-aae4-4a50-bf0f-894c7163a666 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/action" status: 202 len: 0 microversion: 2.1 time: 0.667706 Jul 11 14:10:27.933235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 223/433] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:10:27 2022] POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:10:27.942249 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:27.942913 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:27.954265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:27.955039 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:27.956672 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:27.957629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:27.960731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:27.961054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:27.961867 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:27.962320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:28.012899 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:28.258110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:28.266087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:28.271583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:28.274376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:28.276135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-754a77ae-e655-4fa3-8f0a-0ff4cc7219e1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.369594 Jul 11 14:10:28.278534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a6e974aa-4873-4e7f-9d71-632b1c8fc182 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1755 microversion: 2.1 time: 0.340829 Jul 11 14:10:28.287818 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 211/434] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:27 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:28.292011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 224/435] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:27 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1755 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:10:28.299736 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-f74b1535-674e-453b-a41d-033084c9f231 req-b1436b7f-fa95-4f74-aa9d-0b162f262d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:28.309599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-f74b1535-674e-453b-a41d-033084c9f231 req-b1436b7f-fa95-4f74-aa9d-0b162f262d2f service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:28.310043 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-f74b1535-674e-453b-a41d-033084c9f231 req-b1436b7f-fa95-4f74-aa9d-0b162f262d2f service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:28.323724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-f74b1535-674e-453b-a41d-033084c9f231 req-b1436b7f-fa95-4f74-aa9d-0b162f262d2f service nova] Creating event network-changed:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:10:28.331522 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-f74b1535-674e-453b-a41d-033084c9f231 req-b1436b7f-fa95-4f74-aa9d-0b162f262d2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042125 Jul 11 14:10:28.332128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 212/436] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:29.295053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:29.295577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:29.302760 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:29.303202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:29.304775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:29.305214 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:29.435389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:29.443955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:29.445451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:29.446651 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3310b0a1-9360-4f5e-8b0d-08ae71e818e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.155607 Jul 11 14:10:29.447204 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 225/437] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:29 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:30.465708 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:30.466353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:30.473392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:30.473847 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:30.474639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:30.475078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:30.601738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:30.609785 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:30.611843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:30.612997 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d6dd0b5c-9880-400b-ad93-cffa3d6fd313 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.151651 Jul 11 14:10:30.613557 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 213/438] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:30 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:31.065759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-78c30f98-0879-4757-bd11-6fca4d3497f2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: .version_select at 0x7ffad54119d0>, body: {"keypair": {"name": "tempest-keypair-1935925667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7el9wqXCcbiV0AY0UsJ8CVvGTiJdQDQD6TcWpzoHoplWpqh8ocibijuv/GIjPvTrJfYiahdNPub4uog7+euOPThPOKRXZShz04uqnvbN/bXiCTKEPqH5U8O0FQ4ELrpw=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:31.080304 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-78c30f98-0879-4757-bd11-6fca4d3497f2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:10:31.084197 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-78c30f98-0879-4757-bd11-6fca4d3497f2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:10:31.107421 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-78c30f98-0879-4757-bd11-6fca4d3497f2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045507 Jul 11 14:10:31.108031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 226/439] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:10:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:31.632077 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:31.632684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:31.639210 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:31.639657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:31.640420 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:31.640858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:31.781879 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:31.793147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:31.794780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:31.796050 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-df1b0bb2-3160-44cc-a557-f8ac7cb74284 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.167897 Jul 11 14:10:31.796875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 214/440] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:31 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:31.835423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6cd07599-91e5-4e1e-acd5-94939cd3a424 req-f2448692-6f5d-4275-a4c4-6e395d4b6f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "name": "network-vif-plugged", "status": "completed", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:31.845920 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6cd07599-91e5-4e1e-acd5-94939cd3a424 req-f2448692-6f5d-4275-a4c4-6e395d4b6f3b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:31.846397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6cd07599-91e5-4e1e-acd5-94939cd3a424 req-f2448692-6f5d-4275-a4c4-6e395d4b6f3b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:31.860154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6cd07599-91e5-4e1e-acd5-94939cd3a424 req-f2448692-6f5d-4275-a4c4-6e395d4b6f3b service nova] Creating event network-vif-plugged:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:10:31.866219 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6cd07599-91e5-4e1e-acd5-94939cd3a424 req-f2448692-6f5d-4275-a4c4-6e395d4b6f3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035092 Jul 11 14:10:31.866977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 227/441] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:32.353628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1951374134", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f652801d-32e3-4c8b-a676-9f89f4a15dcd"}], "security_groups": [{"name": "tempest-securitygroup--646771890"}], "key_name": "tempest-keypair-1935925667", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:32.459029 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] validate_networks() for [('f652801d-32e3-4c8b-a676-9f89f4a15dcd', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:10:32.816389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:32.817000 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:32.823534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:32.823831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:10:32.824258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:32.824355 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:10:32.824707 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:10:32.824832 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:32.825108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:10:32.825214 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:32.825512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:10:32.835058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:32.835500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:32.836541 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:32.836994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:32.854184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:10:32.858120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:10:32.869714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:10:32.872014 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:10:32.922261 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-07550148-38ef-4b75-b13b-58ccf65a7b58 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572974 Jul 11 14:10:32.928569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 215/442] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:10:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:10:32.935250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-689717e8-1c9f-4e0e-95ee-20d244c3c7b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:32.935901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-689717e8-1c9f-4e0e-95ee-20d244c3c7b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:32.975820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:32.984028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:32.985538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:32.987278 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0c8d08ec-dfba-4be0-b150-c2fb8e81087e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.175893 Jul 11 14:10:32.987838 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 228/443] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:32 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:32.992281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-689717e8-1c9f-4e0e-95ee-20d244c3c7b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:32.999781 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-689717e8-1c9f-4e0e-95ee-20d244c3c7b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1242 microversion: 2.1 time: 0.069896 Jul 11 14:10:33.000396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 216/444] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:32 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:34.005586 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:34.006207 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:34.013740 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:34.014188 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:34.014977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:34.015408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:34.017160 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:34.017904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:34.024668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:34.025120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:34.025888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:34.026339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:34.139916 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:34.155784 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9caf7edb-da0c-496e-88d0-2e8a83b00a7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1302 microversion: 2.1 time: 0.140196 Jul 11 14:10:34.158552 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 217/445] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:34 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1302 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:10:34.205793 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:34.214371 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:34.215890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:34.217031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-974cbe42-0185-454f-9b8d-73a8a2ba6f4b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.215848 Jul 11 14:10:34.217599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 229/446] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:34 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:35.175108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:35.175829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:35.182654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:35.183177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:35.184127 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:35.184645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:35.235317 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:35.235952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:35.242157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:35.242641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:35.243414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:35.243851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:35.368511 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:35.377220 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aeceb061-6d10-4db7-bf1d-1fdc0a30a7c2 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.205378 Jul 11 14:10:35.387850 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 218/447] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:35 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:35.422884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:35.431782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:35.433578 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:35.434999 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-94517704-53e8-4336-8ca4-09e02bcf73b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.203547 Jul 11 14:10:35.435532 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 230/448] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:35 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:35.522700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-42bdb604-a881-4aeb-934e-5a43e728868d req-f924239d-c3c4-4a79-937a-dcc4093f480d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619764ad-475f-4665-85d2-dfb69d85fa1c", "tag": "d7342fd5-1b82-4926-80b9-ea0bfecd119d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:35.531193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-42bdb604-a881-4aeb-934e-5a43e728868d req-f924239d-c3c4-4a79-937a-dcc4093f480d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:35.541465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-42bdb604-a881-4aeb-934e-5a43e728868d req-f924239d-c3c4-4a79-937a-dcc4093f480d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:35.562644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-42bdb604-a881-4aeb-934e-5a43e728868d req-f924239d-c3c4-4a79-937a-dcc4093f480d service nova] Creating event network-changed:d7342fd5-1b82-4926-80b9-ea0bfecd119d for instance 619764ad-475f-4665-85d2-dfb69d85fa1c on hv-cinder-84842 Jul 11 14:10:35.580888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-42bdb604-a881-4aeb-934e-5a43e728868d req-f924239d-c3c4-4a79-937a-dcc4093f480d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062001 Jul 11 14:10:35.581762 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 219/449] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:36.394544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:36.395176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:36.401252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:36.401694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:36.402477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:36.402905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:36.453630 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:36.454535 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:36.461644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:36.462091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:36.462899 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:36.463336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:36.575544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:36.583510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-02ec73aa-c71a-4461-8434-7c0fb12ad73d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.192825 Jul 11 14:10:36.594590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 231/450] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:36 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:36.625741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:36.634190 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:36.635728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:36.636921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0fc5cc3d-f25d-49c2-b43b-40496acfb7b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.187551 Jul 11 14:10:36.637451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 220/451] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:36 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:37.602134 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:37.602800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:37.608909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:37.609352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:37.610107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:37.610594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:37.656029 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:37.656975 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:37.663966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:37.664640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:37.665411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:37.665849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:37.778584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:37.786725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cc8dc776-f4ba-4672-a21f-e485a3498b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.188397 Jul 11 14:10:37.787298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 232/452] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:37 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:38.070768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:38.079058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:38.081070 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:38.082229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e1acb0f8-87e2-4045-a954-fb474fb1174b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.430441 Jul 11 14:10:38.082812 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 221/453] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:37 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:38.804038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:38.804647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:38.810667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:38.811119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:38.811905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:38.812347 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:38.942756 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:38.950052 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b126f4a0-969d-4d6e-b66e-9ff09ee24a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.150145 Jul 11 14:10:38.950652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 233/454] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:38 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:39.100099 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:39.100706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:39.107480 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:39.107955 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:39.108724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:39.109167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:39.239477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:39.247320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:39.248801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:39.249943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ab5f31fa-0e8b-468f-8889-75392d0f4e2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.153792 Jul 11 14:10:39.250526 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 222/455] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:39 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:39.966141 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:39.966782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:39.973008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:39.973450 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:39.974213 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:39.974671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:40.103792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:40.111708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bdbd5ed3-8aca-4345-be16-4d8f4e0a2d9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.149450 Jul 11 14:10:40.112269 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 234/456] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:39 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:40.268214 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:40.268761 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:40.275461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:40.275907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:40.276660 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:40.277092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:40.403617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:40.411904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:40.413387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:40.414551 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a1117a19-c854-47e2-b639-3e25ecc26ba4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.150326 Jul 11 14:10:40.415098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 223/457] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:40 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:41.129312 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:41.130071 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:41.132405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:41.137684 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:41.138131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:41.138914 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:41.139345 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:41.280519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:41.289154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c7a99153-3aed-442a-836d-e87e8f256df7 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.164375 Jul 11 14:10:41.289741 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 235/458] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:41 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:41.433035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:41.433624 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:41.440747 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:41.441197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:41.441972 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:41.442742 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:41.574934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:41.582896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:41.584411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:41.585867 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-619e8eec-59e7-4a5d-88bd-a125d026995d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1743 microversion: 2.20 time: 0.156811 Jul 11 14:10:41.586452 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 224/459] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:41 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:41.933116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f561cb1a-56dd-4dc8-a4c6-9163a7a1b902 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:41.939161 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f561cb1a-56dd-4dc8-a4c6-9163a7a1b902 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:41.939612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f561cb1a-56dd-4dc8-a4c6-9163a7a1b902 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:41.998440 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f561cb1a-56dd-4dc8-a4c6-9163a7a1b902 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Going to try to stop instance {{(pid=117981) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 14:10:42.040410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f561cb1a-56dd-4dc8-a4c6-9163a7a1b902 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action" status: 202 len: 0 microversion: 2.1 time: 0.110901 Jul 11 14:10:42.041009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 236/460] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:10:41 2022] POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:10:42.049671 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:42.050283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:42.056782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.057232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.057993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.058457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.192512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:42.200521 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bba138af-3c4f-4646-9056-2479e8010e9a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.155279 Jul 11 14:10:42.201086 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 225/461] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:42 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:42.306131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:42.306862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:42.313932 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.314439 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.315213 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.315650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.426445 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-db09d2e4-02e4-4b82-884e-fe6aa2acc476 req-1501692b-372e-4555-9012-6c88c91e8c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619764ad-475f-4665-85d2-dfb69d85fa1c", "name": "network-vif-plugged", "status": "completed", "tag": "d7342fd5-1b82-4926-80b9-ea0bfecd119d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:42.435418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-db09d2e4-02e4-4b82-884e-fe6aa2acc476 req-1501692b-372e-4555-9012-6c88c91e8c67 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.435950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-db09d2e4-02e4-4b82-884e-fe6aa2acc476 req-1501692b-372e-4555-9012-6c88c91e8c67 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.448215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-db09d2e4-02e4-4b82-884e-fe6aa2acc476 req-1501692b-372e-4555-9012-6c88c91e8c67 service nova] Creating event network-vif-plugged:d7342fd5-1b82-4926-80b9-ea0bfecd119d for instance 619764ad-475f-4665-85d2-dfb69d85fa1c on hv-cinder-84842 Jul 11 14:10:42.453353 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:42.453563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-db09d2e4-02e4-4b82-884e-fe6aa2acc476 req-1501692b-372e-4555-9012-6c88c91e8c67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030823 Jul 11 14:10:42.454189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 226/462] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:10:42.461493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-23f82262-02c4-44e0-afec-4e6031cf81b6 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.160189 Jul 11 14:10:42.462123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 237/463] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:42 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:42.604670 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:42.605388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:42.615589 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.616043 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.616901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:42.617382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:42.766276 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:42.775296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:42.776809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:42.777958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3bdc13d3-08cf-4107-a08e-f1791dc046ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.177760 Jul 11 14:10:42.778558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 227/464] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:42 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:43.217381 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:43.218429 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:43.225097 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:43.225840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:43.226848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:43.227480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:43.245477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:43.380321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:43.390205 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b6d964d2-7e95-4b53-ae6d-8deb668e584c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.176924 Jul 11 14:10:43.391119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 238/465] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:43 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:43.478785 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:43.479453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:43.481934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:43.482852 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=8 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:43.490677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:43.491130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:43.491898 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:43.492337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:43.637687 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:43.645465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2279a76f-70f1-4ef6-8e15-324454ed2e68 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.170841 Jul 11 14:10:43.646565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 228/466] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:43 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:43.798208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:43.798846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:43.808535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:43.808992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:43.809871 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:43.810559 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:43.961628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:44.007486 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:44.009272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:44.010719 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-24cf1e5e-f014-4052-9d6a-dbf05278e9ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.217198 Jul 11 14:10:44.011343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 239/467] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:43 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:44.408952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:44.409563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:44.415944 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:44.416527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:44.417291 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:44.417726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:44.553230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:44.561427 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fa2ca8a9-0268-4f54-81e9-e1d543c53500 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.158357 Jul 11 14:10:44.562018 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 229/468] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:44 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:44.663297 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:44.663842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:44.670093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:44.670568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:44.671322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:44.671924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:44.857804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:44.866680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8cdd083c-892b-41a6-be3e-654b49811e38 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1367 microversion: 2.1 time: 0.207686 Jul 11 14:10:44.867250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 240/469] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:44 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:45.034208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:45.034753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:45.040730 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:45.041343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:45.042353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:45.042580 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:45.204422 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:45.215632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:45.217229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:45.218715 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-04db41fa-df4a-4be7-a8a9-5ee75a820b3e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.188850 Jul 11 14:10:45.230093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 230/470] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:45 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:45.579042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:45.579655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:45.586588 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:45.587106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:45.587951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:45.588385 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:45.728155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:45.740168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ce33a377-faca-42f3-b88e-17e776979384 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.164950 Jul 11 14:10:45.741182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 241/471] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:45 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:45.883856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:45.884491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:45.891120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:45.891893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:45.893472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:45.894120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:46.039059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:46.041264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:46.054150 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e3621484-76bb-4958-b2fa-5558315846d3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1556 microversion: 2.1 time: 0.174083 Jul 11 14:10:46.054937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 231/472] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:45 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:46.075441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:46.075441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:46.081655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:46.082159 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:46.083131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:46.083631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:46.169538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ce0cf735-c5f9-4640-a7da-3ac0581ee515 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102171 Jul 11 14:10:46.171053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 242/473] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:10:46 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:46.237856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:46.238583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:46.245479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:46.245936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:46.246746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:46.247194 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:46.513328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:46.522428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:46.524164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:46.525291 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3c170b72-403b-4995-a72f-526c198752c2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.292168 Jul 11 14:10:46.537357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 232/474] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:46 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:46.757212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:46.757822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:46.766007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:46.766493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:46.769381 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:46.772712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:47.025081 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:47.057027 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8839c300-67f5-43ac-acac-aee73ebd624e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.294933 Jul 11 14:10:47.057982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 243/475] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:46 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:47.330644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-3e36276c-94bf-429d-b981-79c0a751da75 req-890647f4-2cec-4b4e-be3b-19beace30d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619764ad-475f-4665-85d2-dfb69d85fa1c", "tag": "d7342fd5-1b82-4926-80b9-ea0bfecd119d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:47.339901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-3e36276c-94bf-429d-b981-79c0a751da75 req-890647f4-2cec-4b4e-be3b-19beace30d37 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:47.340424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-3e36276c-94bf-429d-b981-79c0a751da75 req-890647f4-2cec-4b4e-be3b-19beace30d37 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:47.355457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-3e36276c-94bf-429d-b981-79c0a751da75 req-890647f4-2cec-4b4e-be3b-19beace30d37 service nova] Creating event network-changed:d7342fd5-1b82-4926-80b9-ea0bfecd119d for instance 619764ad-475f-4665-85d2-dfb69d85fa1c on hv-cinder-84842 Jul 11 14:10:47.361839 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-3e36276c-94bf-429d-b981-79c0a751da75 req-890647f4-2cec-4b4e-be3b-19beace30d37 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034105 Jul 11 14:10:47.362783 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 233/476] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:47.544016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:47.545262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:47.551704 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:47.552238 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:47.553094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:47.553595 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:47.703445 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:47.713628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:47.715347 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:47.716836 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-32f2dc5c-11e3-4f21-a326-d086010de826 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.176803 Jul 11 14:10:47.729097 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 244/477] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:47 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:48.076495 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:48.078460 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:48.088951 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:48.089412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:48.090198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:48.090663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:48.256560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:48.266383 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d1391393-7412-40ac-ad51-5503d5117741 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.194444 Jul 11 14:10:48.267150 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 234/478] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:48 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:48.735639 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:48.736919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:48.744315 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:48.744761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:48.745656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:48.746399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:48.893266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:48.902228 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:48.904050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:48.905216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c8e4ea4a-4027-4fbe-a6a8-2e198b299465 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.173469 Jul 11 14:10:48.905977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 245/479] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:48 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:49.284424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:49.284962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:49.291532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:49.291984 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:49.292763 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:49.293197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:49.426746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:49.435983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-23d47a21-a6a5-4337-96b6-25d8129e1ada tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.156206 Jul 11 14:10:49.436565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 235/480] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:49 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:49.924215 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:49.924804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:49.932484 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:49.932950 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:49.933721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:49.934388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:50.071462 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:50.079988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:50.081478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:50.082670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4756d65b-9993-4d23-8d26-7205d9fc2b58 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.162886 Jul 11 14:10:50.083402 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 246/481] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:49 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:50.457801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:50.459590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:50.467272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:50.468249 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:50.469210 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:50.469642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:50.664163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:50.677737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4a9bb109-59fc-444c-8f68-6cb0ae7807d3 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.227761 Jul 11 14:10:50.688202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 236/482] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:50 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:51.100865 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:51.101458 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:51.107707 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:51.108152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:51.108952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:51.109418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:51.259519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:51.269585 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:51.271965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:51.272499 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4553915d-f344-4f1f-8ae8-9a0694557686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.175790 Jul 11 14:10:51.277316 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 247/483] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:51 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:51.695554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:51.696177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:51.703457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:51.704004 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:51.705398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:51.705913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:51.854966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:51.867644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-234c8da7-f852-46b6-a935-8a0ea410cb4c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.175813 Jul 11 14:10:51.870339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 237/484] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:51 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:52.291864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:52.292470 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:52.299681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:52.300129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:52.300884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:52.301571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:52.469917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:52.479920 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:52.481606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:52.482812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e5cc6690-40bc-4624-91fc-0c572f2c0267 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.195269 Jul 11 14:10:52.491515 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 248/485] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:52 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:52.885663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:52.886377 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:52.892766 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:52.893209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:52.893963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:52.894415 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:53.059011 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:53.069328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e1f9a4a3-05e8-4995-9a55-cdba39fa96cf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.187467 Jul 11 14:10:53.070229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 238/486] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:52 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:53.501301 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:53.502085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:53.513866 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:53.514327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:53.515125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:53.515558 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:53.676286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:53.687119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:53.688642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:53.689837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c90fcac8-5822-4798-b0c5-884bb2963a47 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.192484 Jul 11 14:10:53.690419 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 249/487] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:53 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:54.086947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:54.088300 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:54.098281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:54.099211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:54.100224 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:54.100668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:54.259297 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:54.268108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2c99d617-cefc-46e6-b4e1-be2eae7b8f12 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.185045 Jul 11 14:10:54.268727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 239/488] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:54 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:54.707888 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:54.708486 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:54.714500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:54.714938 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:54.715687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:54.716110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:54.846239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:54.854380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:54.855830 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:54.856989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d0aa253d-2f4c-4979-a832-fa31f7c59f52 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1738 microversion: 2.20 time: 0.153090 Jul 11 14:10:54.857551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 250/489] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:54 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:55.292587 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:55.293306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:55.302850 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:55.303389 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:55.304208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:55.304685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:55.446543 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:55.454536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7d9db04c-7edd-46cf-88b8-3da936d68b6e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.172710 Jul 11 14:10:55.455632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 240/490] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:55 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:55.875762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:55.876423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:55.883392 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:55.884134 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:55.884955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:55.885541 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:56.020277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:56.028443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:56.029984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:56.031170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f231ee54-f46e-4c26-94dd-adeba053d0b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1720 microversion: 2.20 time: 0.159453 Jul 11 14:10:56.031740 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 251/491] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:55 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:56.472255 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:56.472871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:56.479730 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:56.480179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:56.480963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:56.481398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:56.616788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:56.625191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5dcb01f0-26e2-4376-af75-277b0a5cd468 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.156837 Jul 11 14:10:56.625777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 241/492] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:56 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:57.049890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:57.050547 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:57.057016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:57.057475 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:57.058250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:57.058710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:57.191743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:57.199680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:57.201195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:57.202518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4cd2c6b7-e4e1-4380-9553-e761f2ce6b93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1720 microversion: 2.20 time: 0.157249 Jul 11 14:10:57.203096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 252/493] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:57 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:57.642889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:57.643493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:57.645843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:57.651059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:57.651499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:57.652250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:57.652677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:57.779632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:57.788660 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d6f6cf0c-d5d6-471f-bf6c-48a95f7b6493 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.149527 Jul 11 14:10:57.789231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 242/494] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:57 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:58.221815 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:58.222493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:58.224394 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:58.229727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:58.230176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:58.231314 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:58.231756 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:58.365840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:58.374358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:58.376035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:58.378112 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d457efd0-065d-4e26-8c9c-75f5c6703e1c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1720 microversion: 2.20 time: 0.160616 Jul 11 14:10:58.378856 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 253/495] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:58 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:10:58.423737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-25da98cc-a89b-422b-983e-ef4b85027d69 req-3029cd3b-c834-408d-944e-e339cf593376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "name": "network-vif-unplugged", "status": "completed", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:58.432893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-25da98cc-a89b-422b-983e-ef4b85027d69 req-3029cd3b-c834-408d-944e-e339cf593376 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:58.433210 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-25da98cc-a89b-422b-983e-ef4b85027d69 req-3029cd3b-c834-408d-944e-e339cf593376 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:58.444868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-25da98cc-a89b-422b-983e-ef4b85027d69 req-3029cd3b-c834-408d-944e-e339cf593376 service nova] Creating event network-vif-unplugged:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:10:58.450384 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-25da98cc-a89b-422b-983e-ef4b85027d69 req-3029cd3b-c834-408d-944e-e339cf593376 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030437 Jul 11 14:10:58.451000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 243/496] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:10:58.805598 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:58.806211 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:58.813142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:58.813614 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:58.815479 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:58.815910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:58.963373 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:58.971516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-252f132b-b1ee-402c-af46-487e2ed6e6c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1720 microversion: 2.1 time: 0.170014 Jul 11 14:10:58.972098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 254/497] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:58 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:10:59.399248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:59.399942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:59.406539 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.407230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.408038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.408493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.540805 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:59.549282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:59.550800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:10:59.552200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4587617a-0633-40a4-9a9c-d5edf46b45e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1663 microversion: 2.20 time: 0.157754 Jul 11 14:10:59.552756 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 244/498] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:10:59 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:10:59.570631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "678ec8e2-9787-48c6-9187-1105255d00bb"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:59.571806 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:59.577788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.578241 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.579059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.580031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.593821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:10:59.860338 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-21569366-cf1b-4f3f-a52a-0e1de7b69b74 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293491 Jul 11 14:10:59.861460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 255/499] 10.222.0.49 () {62 vars in 1363 bytes} [Mon Jul 11 14:10:59 2022] POST /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:10:59.975801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:10:59.976369 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:59.982353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.982811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.983819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.984259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.988916 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:10:59.989520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:10:59.995982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.996430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:10:59.997188 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:10:59.997617 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:00.084913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-620c8d17-7352-46f6-9871-4cedff6638ea tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/action" status: 202 len: 0 microversion: 2.20 time: 0.112939 Jul 11 14:11:00.085516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 245/500] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 11 14:10:59 2022] POST /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:11:00.093195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:00.093793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:00.099774 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:00.100222 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:00.100978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:00.101410 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:00.153833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:00.162239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dcdcbbf2-5ce3-4ac2-b20c-1945c669d629 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1697 microversion: 2.1 time: 0.177585 Jul 11 14:11:00.162937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 256/501] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:10:59 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:11:00.181947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8540f87f-5e35-4af3-838f-0789c106d731 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:11:00.188362 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8540f87f-5e35-4af3-838f-0789c106d731 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:00.189361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8540f87f-5e35-4af3-838f-0789c106d731 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:00.214180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8540f87f-5e35-4af3-838f-0789c106d731 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Going to try to start instance {{(pid=117981) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 14:11:00.243137 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:00.252890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:00.254654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:00.255874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d3f3df98-7188-4d0c-b64b-92517e1adbc8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1749 microversion: 2.20 time: 0.166323 Jul 11 14:11:00.256494 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 246/502] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:00 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:11:00.269755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8540f87f-5e35-4af3-838f-0789c106d731 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action" status: 202 len: 0 microversion: 2.1 time: 0.092355 Jul 11 14:11:00.270546 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 257/503] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:11:00 2022] POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:11:00.278741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:00.279462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:00.286111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:00.286926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:00.287930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:00.288451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:00.441057 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:00.450717 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f84bb43b-91b7-464e-a355-205fd7a92783 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1706 microversion: 2.1 time: 0.175676 Jul 11 14:11:00.454386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 247/504] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:00 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1706 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:01.278926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:01.279727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:01.286249 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:01.286778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:01.287501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:01.287940 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:01.428399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:01.437058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:01.438430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:01.439596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-177d161b-8cc6-4220-a9d2-5ad7c682f0c3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1749 microversion: 2.20 time: 0.167771 Jul 11 14:11:01.440154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 258/505] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:01 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:11:01.468713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:01.469315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:01.476686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:01.477128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:01.477886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:01.478481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:01.612373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:01.615820 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:01.623392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c7f00840-3bfe-40c7-a32f-e6eb125e66bd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1706 microversion: 2.1 time: 0.158387 Jul 11 14:11:01.623963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 248/506] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:01 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1706 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:02.461631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:02.462562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:02.470112 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:02.470666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:02.471534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:02.471968 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:02.632584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:02.640909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:02.642580 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:02.656775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:02.657034 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:02.657536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:02.658956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:02.660121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:02.660794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:02.662510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6d90a455-9dcf-4f9d-a0bc-c7667de7d08c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1751 microversion: 2.20 time: 0.207941 Jul 11 14:11:02.667098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 259/507] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:02 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:02.814948 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:02.825108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7e43595f-d6b5-49e8-a139-068cb6b5fe7e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1710 microversion: 2.1 time: 0.187844 Jul 11 14:11:02.825977 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 249/508] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:02 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1710 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:03.685323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:03.685930 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:03.692489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:03.692970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:03.693732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:03.694168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:03.820884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:03.829527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:03.832367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:03.833546 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-00642cef-2fd0-479f-872b-55b4999df064 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.152291 Jul 11 14:11:03.834100 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 260/509] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:03 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:04.852246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:04.853390 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:04.861204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:04.861686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:04.862500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:04.862941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:05.248491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:05.257771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:05.259300 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:05.260477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cd004402-9938-4460-b5df-0d4b4a24dd86 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.412302 Jul 11 14:11:05.261282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 250/510] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:04 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:06.279351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:06.279948 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:06.286360 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:06.286807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:06.287580 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:06.288013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:06.419995 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:06.429032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:06.430739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:06.431916 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f73a2291-b7a2-4131-b98a-dcb49ac88457 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.156505 Jul 11 14:11:06.432691 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 261/511] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:06 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:07.450748 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:07.451356 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:07.457962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:07.458434 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:07.459210 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:07.459647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:07.598705 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:07.607217 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:07.608714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:07.609856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8663a02a-ba5a-4430-bb88-9b3e9d00ad42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.163412 Jul 11 14:11:07.610467 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 251/512] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:07 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:11:08.628117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:08.628722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:08.634799 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:08.635275 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:08.636034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:08.636477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:08.768848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:08.777709 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:08.779186 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:08.780344 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3673a3eb-9046-4ba4-ba74-45062ea4dbdd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.156300 Jul 11 14:11:08.780896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 262/513] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:08 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:09.799663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:09.801573 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:09.808887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:09.809346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:09.810123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:09.810585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:09.949986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:09.959803 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:09.961328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:09.962507 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fd9e67a5-e513-4bc0-96d1-8fc09486a9c1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.167549 Jul 11 14:11:09.963076 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 252/514] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:09 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:10.987199 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:10.987947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:10.994820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:10.994998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:10.995903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:10.996379 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:11.136126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:11.145172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:11.146657 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:11.147824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0261f3e2-b675-452a-a4af-5cf200dfdc71 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.170421 Jul 11 14:11:11.148393 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 263/515] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:10 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:11:12.165942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:12.166581 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:12.173280 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:12.173773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:12.174561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:12.175019 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:12.309139 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:12.318330 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:12.319823 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:12.320985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ebb51dd2-5188-473e-bffd-675ffdfb34c6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.158992 Jul 11 14:11:12.321520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 253/516] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:12 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:13.340513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:13.341109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:13.347899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:13.348350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:13.349119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:13.349559 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:13.482851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:13.491174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:13.492679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:13.493817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-874d82ec-689d-4bb9-9cbb-c7a456d6f587 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.157547 Jul 11 14:11:13.494427 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 264/517] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:13 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:14.514988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:14.515921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:14.522734 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:14.523180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:14.523966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:14.524398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:14.684457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:14.694343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:14.695881 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:14.697121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b8264ba8-c12a-4fc3-9f36-9c0e0b7cd367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.186070 Jul 11 14:11:14.698017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 254/518] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:14 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:15.723305 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:15.724965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:15.731650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:15.732092 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:15.732867 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:15.733298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:15.880675 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:15.890228 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:15.892374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:15.893618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a4be2504-4a9b-47d3-b4af-696992078057 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.174296 Jul 11 14:11:15.894253 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 265/519] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:15 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:16.912592 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:16.913248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:16.920208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:16.920656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:16.921421 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:16.921849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:17.052644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:17.061171 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:17.062694 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:17.063844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ef4d811e-5a93-4962-8515-535125af37f7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.155199 Jul 11 14:11:17.064400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 255/520] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:16 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:18.082890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:18.083499 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:18.089581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:18.090031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:18.090825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:18.091265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:18.220443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:18.228786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:18.230327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:18.231489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-109cef97-99f9-42dd-ba1b-c6fe4bc7d152 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.153226 Jul 11 14:11:18.232053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 266/521] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:18 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:19.250244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:19.250880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:19.257652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:19.258094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:19.258902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:19.259344 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:19.396664 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:19.405247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:19.406800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:19.407961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-92d8cfa9-662d-4ff1-a275-1e10b84523ef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.161658 Jul 11 14:11:19.408526 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 256/522] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:19 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:20.426341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:20.426955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:20.433081 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:20.433522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:20.434336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:20.434757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:20.566064 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:20.574669 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:20.576179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:20.577338 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1f8e81d4-1512-42ed-a777-77621eb24209 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.155237 Jul 11 14:11:20.578058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 267/523] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:20 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:21.599194 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:21.599829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:21.606433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:21.606881 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:21.607643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:21.608073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:21.742749 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:21.752196 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:21.753714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:21.754950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-51caddff-2024-474e-98d4-793bea1df644 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.160285 Jul 11 14:11:21.755506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 257/524] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:21 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:22.773310 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:22.773872 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:22.779899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:22.780350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:22.781115 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:22.781553 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:22.796954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:22.919455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:22.928554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:22.930110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:22.931348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9debcf0b-5a60-4af1-8def-e0d37d661542 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.162098 Jul 11 14:11:22.931918 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 268/525] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:22 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:23.948994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:23.949596 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:23.957115 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:23.957590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:23.958391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:23.958829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:24.096045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:24.104619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:24.106123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:24.107321 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e0bf149e-1568-40eb-ba22-797a18ca95f3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.162314 Jul 11 14:11:24.107886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 258/526] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:23 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:25.126058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:25.126687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:25.132646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:25.133087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:25.133841 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:25.134265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:25.262082 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:25.271179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:25.272673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:25.273841 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-206b1a16-6402-432d-ad46-d04d74965430 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.151650 Jul 11 14:11:25.274426 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 269/527] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:25 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:26.292875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:26.293487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:26.300816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:26.301543 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:26.302525 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:26.303068 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:26.438042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:26.446946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:26.448428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:26.449576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f642d89f-7bee-4254-85c1-0415f17e9b94 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.160818 Jul 11 14:11:26.450125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 259/528] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:26 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:27.468447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:27.469072 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:27.475876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:27.476326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:27.477084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:27.477521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:27.611917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:27.620594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:27.622110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:27.623303 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3953f57e-2188-48cf-bf5c-72a373ede7f5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.158825 Jul 11 14:11:27.623864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 270/529] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:27 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:28.641751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:28.642418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:28.644864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=38 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:28.650182 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:28.650647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:28.651423 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:28.651855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:28.787461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:28.796513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:28.798636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:28.799960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-05ce86b0-31cc-45ad-bdbd-32f183a8a5e9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.162646 Jul 11 14:11:28.800509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 260/530] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:28 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:29.819386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:29.819962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:29.821805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=36 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:29.827225 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:29.827678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:29.828488 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:29.828929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:29.971970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:29.981200 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:29.982753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:29.983927 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d75202ed-5eca-470b-a6a2-90feb35c87cf tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.168725 Jul 11 14:11:29.984489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 271/531] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:29 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:31.008082 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:31.008699 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:31.015672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:31.016608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:31.017401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:31.017842 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:31.159152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:31.168228 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:31.169750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:31.171056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6531be87-2eee-4043-b608-867fc22f9f99 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.167103 Jul 11 14:11:31.171636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 261/532] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:31 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:32.190477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:32.191542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:32.198237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:32.198711 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:32.199487 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:32.199925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:32.328926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:32.337764 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:32.339308 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:32.340479 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-713b912d-a245-45df-86a5-f9ad1c571097 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.154559 Jul 11 14:11:32.341044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 272/533] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:32 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:32.888267 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-109e8ab6-4989-493b-b2ed-ca038f508b9c req-a4dd94ea-cdfc-4678-bf6d-e61af0709b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "name": "network-vif-plugged", "status": "completed", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:11:32.897571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-109e8ab6-4989-493b-b2ed-ca038f508b9c req-a4dd94ea-cdfc-4678-bf6d-e61af0709b10 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:32.898184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-109e8ab6-4989-493b-b2ed-ca038f508b9c req-a4dd94ea-cdfc-4678-bf6d-e61af0709b10 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:32.901418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=80 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:32.911486 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-109e8ab6-4989-493b-b2ed-ca038f508b9c req-a4dd94ea-cdfc-4678-bf6d-e61af0709b10 service nova] Creating event network-vif-plugged:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:11:32.916588 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-109e8ab6-4989-493b-b2ed-ca038f508b9c req-a4dd94ea-cdfc-4678-bf6d-e61af0709b10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Jul 11 14:11:32.917209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 262/534] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:11:33.359161 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:33.360381 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:33.366654 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:33.367104 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:33.367969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:33.368410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:33.375752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5823094-7686-48da-95d0-8047c35679dc"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:11:33.377191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:33.384514 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:33.385594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:33.386502 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:33.386964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:33.541143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:33.559919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:33.564334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:33.567849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3db6cf91-7744-489a-9455-5d8ce659ac2f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.212090 Jul 11 14:11:33.569697 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 273/535] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:33 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:33.690720 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-23c0c178-6173-4422-94ad-bfde5c107063 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319796 Jul 11 14:11:33.691336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 263/536] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:11:33 2022] POST /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:11:34.596538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:34.597092 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:34.603722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:34.604189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:34.604991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:34.605429 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:34.749046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:34.758056 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:34.759758 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:34.760925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-eb1af415-254b-438f-9ec6-a199ffa67e1f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.169084 Jul 11 14:11:34.761490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 274/537] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:34 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:35.781952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:35.783422 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:35.794403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:35.794903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:35.795850 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:35.796294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:35.964714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:35.975218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:35.977398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:35.978215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c339a5fa-3477-45a1-b2d3-4177eb80d2ad tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1807 microversion: 2.20 time: 0.201309 Jul 11 14:11:35.979714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 264/538] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:35 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:36.998122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:36.998762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:37.005119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:37.005572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:37.006365 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:37.006805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:37.142797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:37.151628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:37.153187 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:37.154406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a15e9e5c-8893-4c75-8d6d-130d2f467548 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1794 microversion: 2.20 time: 0.160200 Jul 11 14:11:37.154969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 275/539] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:11:36 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:11:38.049012 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:11:38.049978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:38.056962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:38.057421 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:38.058200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:38.058668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:38.082745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lazy-loading 'flavor' on Instance uuid 0562d881-0ee4-4314-ad52-5a3ab9b17bcf {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:11:38.212331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f61d9f5e-6d0c-462d-8452-895b3622b0a0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/action" status: 200 len: 32 microversion: 2.1 time: 0.167758 Jul 11 14:11:38.212857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 265/540] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:11:38 2022] POST /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:11:38.224891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:38.225518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:38.232527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:38.232935 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:38.233802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:38.234436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:38.384324 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:38.392428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7e18a20a-8358-42e8-9b63-7cff04c32b14 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.171434 Jul 11 14:11:38.393003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 276/541] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:38 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:39.410839 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:39.411537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:39.417878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:39.418353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:39.419128 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:39.419565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:39.553081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:39.561227 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f31e0546-62ce-4892-9478-9dbd60570573 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.155168 Jul 11 14:11:39.561862 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 266/542] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:39 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:40.579273 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:40.579907 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:40.586251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:40.586722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:40.587613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:40.588057 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:40.762842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:40.771084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2955d224-9121-46f7-8799-2afa7077160b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.196304 Jul 11 14:11:40.771672 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 277/543] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:40 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:41.787948 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:41.788561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:41.795644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:41.796091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:41.797400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:41.797833 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:41.946254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:41.955102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8cfeaa64-6fde-479e-9fb3-7194b86f395f tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.170943 Jul 11 14:11:41.955741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 267/544] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:41 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:42.973340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:42.973994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:42.980545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:42.981058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:42.981897 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:42.982424 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:43.132633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:43.141160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ad214930-fd2c-421d-896c-f5a62aa0ad39 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.171763 Jul 11 14:11:43.141746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 278/545] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:42 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:44.161561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:44.162154 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:44.169331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:44.169775 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:44.170586 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:44.171022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:44.316933 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:44.325380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-66409774-f0a8-494e-87fb-1f3d8a95d9ec tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.167729 Jul 11 14:11:44.325981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 268/546] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:44 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:45.342316 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:45.342891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:45.349631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:45.350070 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:45.350865 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:45.351301 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:45.484633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:45.493017 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bd2fcf73-6db2-4168-b129-94fbad20feb8 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.154543 Jul 11 14:11:45.493611 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 279/547] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:45 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:46.510241 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:46.510874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:46.517304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:46.517827 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:46.518612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:46.519044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:46.649095 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:46.657554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-29497d0c-c4bf-4f00-b72b-85373762e2b1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.151321 Jul 11 14:11:46.658112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 269/548] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:46 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:47.675582 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:47.676513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:47.682538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:47.682991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:47.683748 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:47.684186 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:47.814521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:47.822374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3cede50b-b28d-435b-85a5-88c118c8e0e9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.151294 Jul 11 14:11:47.822936 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 280/549] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:47 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:48.840272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:48.840880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:48.848250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:48.848731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:48.849605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:48.849947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:48.986404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:48.994575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2323e509-394d-4fef-a4ba-78fae12975d7 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.158112 Jul 11 14:11:48.995147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 270/550] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:48 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:50.011903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:50.012523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:50.019221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:50.019706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:50.020514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:50.020966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:50.166787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:50.175786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2082e54b-11b7-426d-bd2a-d9e5ddc298d3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.167651 Jul 11 14:11:50.176625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 281/551] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:50 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:51.193575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:51.194176 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:51.200998 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:51.201449 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:51.202210 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:51.202708 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:51.396394 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:51.404588 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-63722fac-58ef-43ed-b682-28acc9199262 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.214852 Jul 11 14:11:51.405164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 271/552] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:51 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:52.422045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:52.422699 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:52.428950 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:52.429395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:52.430157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:52.430645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:52.611724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:52.619683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f243b684-e84d-44c5-b067-90786a916247 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.201536 Jul 11 14:11:52.620233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 282/553] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:52 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:53.637523 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:53.638168 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:53.645620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:53.646062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:53.646879 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:53.647400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:53.778816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:53.787324 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b5678300-33a3-45bd-8bfc-d3d6523b7eb2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.153730 Jul 11 14:11:53.787885 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 272/554] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:53 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:53.931075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:11:53.932011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:53.938781 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:53.939232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:53.940016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:53.940442 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:53.943237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=88 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:54.018173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e084301c-cfbd-49f4-a672-855df69de83e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/action" status: 202 len: 0 microversion: 2.1 time: 0.091252 Jul 11 14:11:54.019208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 283/555] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:11:53 2022] POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:11:54.027462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:54.028093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:54.034416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:54.034867 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:54.035640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:54.036073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:54.192624 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:54.202714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a70c4318-25f5-4a70-a7c5-9b927403230c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1747 microversion: 2.1 time: 0.179101 Jul 11 14:11:54.204519 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 273/556] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:54 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1747 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:54.805391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:54.806011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:54.814478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:54.814953 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:54.815724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:54.816154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:54.950170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:54.958725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5d83fc9b-ff05-4c9f-8d4c-3def66506df2 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.157884 Jul 11 14:11:54.959298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 284/557] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:54 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:55.221025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:55.221627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:55.228088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:55.228531 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:55.229282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:55.229709 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:55.374975 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:55.383337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d2d7eab5-4289-4020-bb0f-622c9f8e5461 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1747 microversion: 2.1 time: 0.166106 Jul 11 14:11:55.383923 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 274/558] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:55 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:55.975804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:55.976409 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:55.982472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:55.982916 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:55.984201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:55.984661 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:56.123969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:56.132123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d623dff3-32a2-4881-9da1-28ab28143747 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.160110 Jul 11 14:11:56.132720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 285/559] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:55 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:56.401127 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:56.401734 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:56.408742 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:56.409187 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:56.409939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:56.410399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:56.551315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:56.559106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-097884eb-f998-4498-aed4-dfe8a48b663c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1747 microversion: 2.1 time: 0.161830 Jul 11 14:11:56.559661 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 275/560] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:56 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:57.149038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:57.149630 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:57.156178 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:57.156620 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:57.157375 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:57.157806 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:57.293003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:57.301374 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cd51bd3e-0aad-4aee-a46f-7813573ed0ca tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.155959 Jul 11 14:11:57.301949 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 286/561] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:57 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:57.576569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:57.577207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:57.584798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:57.585248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:57.586022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:57.586491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:57.590218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:57.735574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:57.743809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c5e808de-7cac-4fed-a502-c3fcd1e1f606 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.171075 Jul 11 14:11:57.744595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 276/562] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:57 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:58.319094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:58.319703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:58.325732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:58.326179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:58.326974 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:58.327460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:58.456423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:58.464592 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ff2516da-74ef-483d-9c4e-bcf2f9fb3cbc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1734 microversion: 2.1 time: 0.149259 Jul 11 14:11:58.465267 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 287/563] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:58 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:58.761555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:58.762204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:58.764539 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=34 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:58.770801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:58.771253 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:58.772033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:58.772474 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:58.933529 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:58.941902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e91c1592-8d93-479f-b946-1be2874a025f tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.184281 Jul 11 14:11:58.942516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 277/564] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:58 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:59.481943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:59.482587 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:59.489372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.489827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.490632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.491071 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.640084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:11:59.652625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a0611fa4-85a7-4590-bc5a-9eb6880e2700 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1714 microversion: 2.1 time: 0.174610 Jul 11 14:11:59.653230 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 288/565] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:59 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:11:59.763422 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:59.764015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:59.770592 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.771046 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.771831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.772272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.905248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] HTTP exception thrown: Cannot 'detach_volume' instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf while it is in vm_state rescued Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Request method failure captured: Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments/a5823094-7686-48da-95d0-8047c35679dc HTTP/1.1 Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Fsgmr1WTgQMKE5hZq2R64VsT0RCNwaHcoEocjE6DVCgURtIa0Bcl1Q2PVcJyb5htuG_AlChwJobYgN43aTlJwZLRkIhueXYPWK8UtUHtsY5wR57LfgWYKdNGbi-dwY2UFbve_MPkoFxtLHNT1hA3eEMvpjHNo1hoXRH3M7As_Cuc Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:11:59.906966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b181bc391914f6abcea09b894b88473", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b181bc391914f6abcea09b894b88473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}] Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: cf6cc756845148ee8fce9021425cb7cb Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:11:59.908560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Cannot 'detach_volume' instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf while it is in vm_state rescued Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'server_id': '0562d881-0ee4-4314-ad52-5a3ab9b17bcf', 'id': 'a5823094-7686-48da-95d0-8047c35679dc'} Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:11:59.909299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf while it is in vm_state rescued Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf while it is in vm_state rescued Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:11:59.910952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Returning 409 to user: Cannot 'detach_volume' instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf while it is in vm_state rescued {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:11:59.912157 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0b088962-4dbd-4cc0-b3c3-00f0855cb0fc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments/a5823094-7686-48da-95d0-8047c35679dc" status: 409 len: 152 microversion: 2.1 time: 0.149194 Jul 11 14:11:59.912157 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 278/566] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:11:59 2022] DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments/a5823094-7686-48da-95d0-8047c35679dc => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 11 14:11:59.918824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:11:59.919364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:59.921344 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=36 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:59.927382 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.927836 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.928618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.929060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.960747 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:11:59.961352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:11:59.968691 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.969138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:11:59.970034 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:11:59.970500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:00.002683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-81bdddff-cc40-4ffb-84c0-6301248d4954 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "POST /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/action" status: 202 len: 0 microversion: 2.1 time: 0.087616 Jul 11 14:12:00.003562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 289/567] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:11:59 2022] POST /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:00.012528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:00.013176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:00.021785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:00.021785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:00.022612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:00.023050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:00.194174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:00.203967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6dbef658-b39e-4241-8d35-bd51ed1437ed tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.247637 Jul 11 14:12:00.204865 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 279/568] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:11:59 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:00.224721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:00.234194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0be49238-83a1-49c5-b66c-f4e0eab7c7f5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1722 microversion: 2.1 time: 0.225342 Jul 11 14:12:00.234918 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 290/569] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:00 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:01.221389 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:01.221990 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:01.228549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:01.228985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:01.229732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:01.230157 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:01.252642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:01.253248 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:01.259268 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:01.259710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:01.260472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:01.260904 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:01.434888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:01.443376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-909e3e8d-23c4-4400-af64-623f10b45f84 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.225935 Jul 11 14:12:01.443943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 280/570] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:01 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:01.448837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:01.457325 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-55ba2daa-336c-4503-b7a6-2f2ee9371f56 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1722 microversion: 2.1 time: 0.209110 Jul 11 14:12:01.457882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 291/571] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:01 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:02.461037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:02.461649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:02.468795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:02.469244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:02.470096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:02.470564 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:02.528415 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:02.529050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:02.536586 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:02.537038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:02.537811 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:02.538248 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:02.662994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:02.671190 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0cce25c6-fb4a-412f-ad0f-d307e71b5c98 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.213934 Jul 11 14:12:02.671779 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 281/572] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:02 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:02.698431 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:02.706763 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-03cc4299-bc4c-4b7e-ba51-1a7160c2ea70 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1722 microversion: 2.1 time: 0.235870 Jul 11 14:12:02.707331 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 292/573] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:02 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:03.689438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:03.690052 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:03.696624 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:03.697071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:03.697834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:03.698266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:03.726243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:03.727086 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:03.733421 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:03.733954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:03.734867 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:03.735379 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:03.908198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:03.916230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1091b4d7-1684-46d7-be16-45149e87227e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.231234 Jul 11 14:12:03.916800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 282/574] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:03 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:03.926073 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:03.934256 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a439b332-9ac4-49f5-8d37-b622771ac870 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1722 microversion: 2.1 time: 0.211845 Jul 11 14:12:03.935026 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 293/575] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:03 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:04.934366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:04.934908 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:04.941274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:04.941717 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:04.942497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:04.942932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:04.951444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:04.952057 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:04.958586 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:04.959096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:04.959797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:04.960235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:05.167014 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:05.170584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:05.175537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f301bd98-4f3b-4bfe-8ca4-e6c8a410478d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.245177 Jul 11 14:12:05.176383 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 283/576] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:04 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:05.179085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f92acc3d-1b87-4f37-accd-f47140274245 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1728 microversion: 2.1 time: 0.231442 Jul 11 14:12:05.179652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 294/577] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:04 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:05.195608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:05.196036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:05.201988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:05.203028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:05.203787 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:05.204219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:05.280259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7a8dfab7-ddab-4846-8a1f-76073370debe tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087898 Jul 11 14:12:05.281361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 284/578] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:12:05 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:12:06.136729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-a55966a3-eb98-4c55-ade1-be764b4caa7a req-1863afef-ad81-41e1-9389-d2140ee0289b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0562d881-0ee4-4314-ad52-5a3ab9b17bcf", "tag": "0a982454-2ed0-4dd2-bc29-6243369d5594"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:06.146358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a55966a3-eb98-4c55-ade1-be764b4caa7a req-1863afef-ad81-41e1-9389-d2140ee0289b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:06.147122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a55966a3-eb98-4c55-ade1-be764b4caa7a req-1863afef-ad81-41e1-9389-d2140ee0289b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:06.159663 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-a55966a3-eb98-4c55-ade1-be764b4caa7a req-1863afef-ad81-41e1-9389-d2140ee0289b service nova] Creating event network-changed:0a982454-2ed0-4dd2-bc29-6243369d5594 for instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf on hv-cinder-84842 Jul 11 14:12:06.165837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-a55966a3-eb98-4c55-ade1-be764b4caa7a req-1863afef-ad81-41e1-9389-d2140ee0289b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032801 Jul 11 14:12:06.166682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 295/579] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:06.193797 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:06.194620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:06.201247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:06.201902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:06.203506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:06.204113 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:06.358987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:06.367523 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a2cb2130-8cf8-4f35-8e50-019eded00771 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.178018 Jul 11 14:12:06.368099 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 285/580] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:06 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:06.377696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:12:06.378117 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:12:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:12:07.385729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:07.386368 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:07.393264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:07.393720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:07.394540 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:07.395002 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:07.537896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:07.546060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-47b05373-9dea-4a61-b50d-fc84cc88f17d tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.164628 Jul 11 14:12:07.546656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 296/581] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:07 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:08.180269 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-6aa591c8-841a-4f7a-a674-e1b9944ab2ac req-81cfe5b1-155c-422f-a2a5-c06897ad23e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0562d881-0ee4-4314-ad52-5a3ab9b17bcf", "tag": "0a982454-2ed0-4dd2-bc29-6243369d5594"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:08.189380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6aa591c8-841a-4f7a-a674-e1b9944ab2ac req-81cfe5b1-155c-422f-a2a5-c06897ad23e4 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:08.189827 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-6aa591c8-841a-4f7a-a674-e1b9944ab2ac req-81cfe5b1-155c-422f-a2a5-c06897ad23e4 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:08.204015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-6aa591c8-841a-4f7a-a674-e1b9944ab2ac req-81cfe5b1-155c-422f-a2a5-c06897ad23e4 service nova] Creating event network-changed:0a982454-2ed0-4dd2-bc29-6243369d5594 for instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf on hv-cinder-84842 Jul 11 14:12:08.209053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-6aa591c8-841a-4f7a-a674-e1b9944ab2ac req-81cfe5b1-155c-422f-a2a5-c06897ad23e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032437 Jul 11 14:12:08.209814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 286/582] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:08.563959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:08.564648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:08.571008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:08.571459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:08.572218 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:08.572653 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:08.709276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:08.717902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b7b96525-c1e8-4b48-a49c-6767d44b27f7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.158364 Jul 11 14:12:08.718516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 297/583] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:08 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:09.735130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:09.735817 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:09.742499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:09.742945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:09.743696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:09.744482 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:09.893793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:09.904000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e4934106-0c8b-4f4d-8627-e40c74bad451 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1752 microversion: 2.1 time: 0.172896 Jul 11 14:12:09.904674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 287/584] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:09 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:10.922578 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:10.923179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:10.929450 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:10.929895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:10.930659 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:10.931087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:10.945686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:11.075733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:11.084892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d08e0c87-cf65-4138-927d-7c46a93cb73b tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1755 microversion: 2.1 time: 0.166154 Jul 11 14:12:11.085462 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 298/585] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:10 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:16.113290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:12:16.113888 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:12:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:12:22.259789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=21 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:22.260440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=65 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:22.365931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:22.366462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:22.372331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:22.372784 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:22.373546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:22.373997 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:22.454147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lazy-loading 'services' on Instance uuid e4c538a6-c82b-4cc8-be39-aecd9c223140 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:12:22.567369 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32baa5ed-219c-4b24-a15e-ff9d32c29723 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-volume_attachments/5bacfad8-c19a-46d4-9993-6d1ce9e8c59e" status: 202 len: 0 microversion: 2.1 time: 0.312706 Jul 11 14:12:22.567963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 288/586] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:12:22 2022] DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-volume_attachments/5bacfad8-c19a-46d4-9993-6d1ce9e8c59e => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:24.734091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-32eb5710-5361-4611-91ce-5c64e625cf11 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:24.736252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=19 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:24.736902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:24.742628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32eb5710-5361-4611-91ce-5c64e625cf11 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:24.743081 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-32eb5710-5361-4611-91ce-5c64e625cf11 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:24.765057 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-32eb5710-5361-4611-91ce-5c64e625cf11 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Going to try to stop instance {{(pid=117981) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 11 14:12:24.807388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-32eb5710-5361-4611-91ce-5c64e625cf11 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action" status: 202 len: 0 microversion: 2.1 time: 0.077105 Jul 11 14:12:24.807978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 299/587] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:12:24 2022] POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:24.817757 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:24.818483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:24.824751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:24.825208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:24.826001 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:24.826451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:25.208018 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:25.215572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-956192a2-840d-4972-887d-09b6985d1cd5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.403100 Jul 11 14:12:25.216134 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 289/588] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:24 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:26.234173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:26.235504 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:26.241902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:26.242383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:26.243147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:26.243579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:26.370166 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:26.377606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-63ed2943-2fc5-455d-bc79-b581f2f21320 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.148009 Jul 11 14:12:26.378156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 300/589] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:26 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:27.395356 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:27.395974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:27.402483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:27.402936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:27.403702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:27.404147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:27.536629 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:27.544113 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-02e69758-aa06-4aed-9d55-effad38067f9 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.152700 Jul 11 14:12:27.544667 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 290/590] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:27 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:28.561291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:28.561898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:28.568474 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:28.568925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:28.569694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:28.570133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:28.698767 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:28.706131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9856b2da-b41e-4f2b-9de4-0d0e797de1e7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.148803 Jul 11 14:12:28.706823 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 301/591] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:28 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:29.723773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:29.724385 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:29.730873 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:29.731315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:29.732080 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:29.732542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:29.866033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:29.873448 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5bf073f4-7e48-40fe-a537-98ed5501b4bc tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.153578 Jul 11 14:12:29.874003 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 291/592] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:29 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:30.732403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:30.732901 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:30.739587 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.740035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.740794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.741229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.763756 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-37b84a6d-1b0b-42ff-b3fe-d4b64c1084a4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/ips" status: 200 len: 148 microversion: 2.1 time: 0.084250 Jul 11 14:12:30.764343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 302/593] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:12:30 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/ips => generated 148 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:30.774819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:30.775971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:30.783094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.783540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.784302 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.784737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.863889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Invalid volume: volume f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 is already attached to instances: b2bf941c-f166-4236-b1dc-c7943dfa23cb Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: POST /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/os-volume_attachments HTTP/1.1 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 74 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:12:30.865625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {"volumeAttachment": {"volumeId": "f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2"}} Jul 11 14:12:30.867221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Invalid volume: volume f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 is already attached to instances: b2bf941c-f166-4236-b1dc-c7943dfa23cb Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'server_id': '619764ad-475f-4665-85d2-dfb69d85fa1c', 'body': {'volumeAttachment': {'volumeId': 'f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2'}}} Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 is already attached to instances: b2bf941c-f166-4236-b1dc-c7943dfa23cb Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:30.868021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 is already attached to instances: b2bf941c-f166-4236-b1dc-c7943dfa23cb Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:30.869177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 is already attached to instances: b2bf941c-f166-4236-b1dc-c7943dfa23cb Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 400 to user: Invalid volume: volume f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 is already attached to instances: b2bf941c-f166-4236-b1dc-c7943dfa23cb {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-505f795a-ba63-4739-b888-36cb764b722c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096370 Jul 11 14:12:30.870397 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 292/594] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:12:30 2022] POST /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:12:30.876464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:30.876959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:30.883169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.883613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.884372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.884807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.893269 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:30.893880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:30.901135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.901585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.902418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:30.902857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:30.910800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:12:30.992444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-99a507ce-d824-44cc-9bea-856ed3e12347 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 204 len: 0 microversion: 2.1 time: 0.119941 Jul 11 14:12:30.996459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 303/595] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:12:30 2022] DELETE /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:12:31.002904 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:31.003594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:31.009805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:31.010341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:31.011172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:31.011610 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:31.037188 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:31.044693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bf295a2c-8b44-45d1-b4df-b70a7b07f954 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.156540 Jul 11 14:12:31.045250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 293/596] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:30 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:31.140121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:31.147531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-60afd9fc-3972-4585-9051-4086d13cbe39 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1680 microversion: 2.1 time: 0.149544 Jul 11 14:12:31.148090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 304/597] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:30 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:32.062868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:32.063404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:32.069713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:32.070154 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:32.070939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:32.071374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:32.164994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:32.165603 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:32.171671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:32.172133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:32.172890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:32.173322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:32.201110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:32.209283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4aafa077-26d5-4d80-8233-4c7b5d8aeccd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.150883 Jul 11 14:12:32.209927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 294/598] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:32 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:32.300933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:32.308289 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-35909c5b-61b9-456b-bc8d-9a3b842f6ff1 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1680 microversion: 2.1 time: 0.147220 Jul 11 14:12:32.308846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 305/599] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:32 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:33.227032 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:33.227644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:33.234708 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:33.235158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:33.235920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:33.236351 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:33.330723 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:33.331673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:33.341812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:33.343035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:33.344019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:33.344817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:33.398970 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:33.407653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7bdbf3ce-72c8-4c3f-ad63-c623bb4ec4e2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.184461 Jul 11 14:12:33.408572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 295/600] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:33 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:33.500403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:33.507845 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ef21312c-1f61-400f-b179-741fe3d6b7df tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1680 microversion: 2.1 time: 0.184577 Jul 11 14:12:33.508414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 306/601] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:33 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:34.043688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-098272a2-b639-4c71-b049-661b114db04d req-bfb4e71e-6056-40a8-9ed8-a29131b4815b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619764ad-475f-4665-85d2-dfb69d85fa1c", "name": "network-vif-deleted", "tag": "d7342fd5-1b82-4926-80b9-ea0bfecd119d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:34.053388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-098272a2-b639-4c71-b049-661b114db04d req-bfb4e71e-6056-40a8-9ed8-a29131b4815b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:34.053838 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-098272a2-b639-4c71-b049-661b114db04d req-bfb4e71e-6056-40a8-9ed8-a29131b4815b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:34.068310 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-098272a2-b639-4c71-b049-661b114db04d req-bfb4e71e-6056-40a8-9ed8-a29131b4815b service nova] Creating event network-vif-deleted:d7342fd5-1b82-4926-80b9-ea0bfecd119d for instance 619764ad-475f-4665-85d2-dfb69d85fa1c on hv-cinder-84842 Jul 11 14:12:34.074136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-098272a2-b639-4c71-b049-661b114db04d req-bfb4e71e-6056-40a8-9ed8-a29131b4815b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112276 Jul 11 14:12:34.078668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 296/602] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:34.426044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:34.427324 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:34.433690 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:34.434144 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:34.434944 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:34.435377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:34.528388 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:34.529100 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:34.540556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:34.542997 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:34.543888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:34.544654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:34.580380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:34.580902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:34.581567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lazy-loading 'fault' on Instance uuid 619764ad-475f-4665-85d2-dfb69d85fa1c {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:12:34.582727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:34.591684 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d9cab7f9-3335-4624-8fe3-7eb2a84fcd94 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.170428 Jul 11 14:12:34.592594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 307/603] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:34 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:34.636345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:34.643450 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-64146774-90bd-4086-8973-f14d2ac31e52 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 200 len: 1332 microversion: 2.1 time: 0.121390 Jul 11 14:12:34.644457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 297/604] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:34 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:35.609587 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:35.610106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:35.616331 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:35.616790 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:35.617555 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:35.618063 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:35.660977 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:35.661602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:35.668078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:35.668534 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:35.669317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:35.669804 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:35.684653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c HTTP/1.1 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:12:35.686317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:12:35.688414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '619764ad-475f-4665-85d2-dfb69d85fa1c'} Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:12:35.689305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:12:35.690554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:35.691839 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:12:35.691839 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-54f38cd0-da7a-44fb-9e51-2f76f53d9def tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 404 len: 111 microversion: 2.1 time: 0.031454 Jul 11 14:12:35.692257 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 298/605] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:35 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:12:35.697206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-700eef6c-2679-4371-9cae-bd159f78697a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '.version_select at 0x7ffad52cb310>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:35.721857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-700eef6c-2679-4371-9cae-bd159f78697a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935925667" status: 202 len: 0 microversion: 2.1 time: 0.028365 Jul 11 14:12:35.722770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 299/606] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 11 14:12:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935925667 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:12:35.767584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:35.776212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b499ccf9-3c76-41a7-a760-d82dd888fc2a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.171024 Jul 11 14:12:35.777319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 308/607] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:35 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:36.421558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:36.422042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:36.430788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:36.431246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:36.432009 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:36.432453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:36.513952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lazy-loading 'services' on Instance uuid b2bf941c-f166-4236-b1dc-c7943dfa23cb {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:12:36.596940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0a5ee8d2-177d-4476-84bd-cf345552cc6c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments/f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2" status: 202 len: 0 microversion: 2.1 time: 0.179134 Jul 11 14:12:36.597883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 300/608] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:12:36 2022] DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments/f5b3ed16-cb6b-4a7a-af3b-21d9df5639c2 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:36.606964 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:36.607983 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:36.615949 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:36.616590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:36.617430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:36.617984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:36.654862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-20bfccce-33ae-4e6a-9c03-ae1eb8baca7c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052583 Jul 11 14:12:36.655366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 309/609] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:12:36 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:36.795585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:36.796285 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:36.803143 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:36.803587 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:36.804358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:36.804790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:36.946201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:36.953741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2ff2b812-952a-4292-8ec0-a6e37693c8c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.163578 Jul 11 14:12:36.954332 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 301/610] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:36 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:37.665663 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:37.666615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:37.673072 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:37.673517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:37.674278 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:37.674738 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:37.706212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-991c3c40-d349-4bd5-a4f9-565fc97f8fa9 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Jul 11 14:12:37.706722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 310/611] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:12:37 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:37.970737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:37.971272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:37.977722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:37.978164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:37.978956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:37.979386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:38.112204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:38.119922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2e4ea59f-0e1c-4488-b290-038b60ed6c5e tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.152997 Jul 11 14:12:38.120505 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 302/612] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:37 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:38.718010 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:38.719550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:38.725525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:38.725959 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:38.726746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:38.727173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:38.756152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-683abe7d-d4a7-4871-8967-525f7b5fb394 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041980 Jul 11 14:12:38.756721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 311/613] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:12:38 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:12:38.816945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:38.817441 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:38.824154 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:38.824609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:38.825382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:38.825836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:38.851985 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:12:38.899352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:38.935846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9c488722-c579-444b-85fd-69814344ad13 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 204 len: 0 microversion: 2.1 time: 0.122386 Jul 11 14:12:38.937030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 303/614] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:12:38 2022] DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:12:38.944891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:38.945648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:38.951706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:38.952156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:38.952975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:38.953410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:39.085285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:39.093680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6bfd14f5-b1e4-4a8e-96f6-7e74b199903c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1682 microversion: 2.1 time: 0.152200 Jul 11 14:12:39.094252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 312/615] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:38 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:39.137591 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:39.138342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:39.145777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:39.146223 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:39.147023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:39.147457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:39.288381 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:39.296684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f8dc5537-92ea-4fc6-95f8-47598a27129b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.162814 Jul 11 14:12:39.297316 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 304/616] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:39 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:40.110910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:40.111524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:40.117638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:40.118085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:40.118882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:40.119314 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:40.123631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:40.251179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:40.258719 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d7d116ef-7eeb-4e41-8151-f4789f427c93 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1682 microversion: 2.1 time: 0.151543 Jul 11 14:12:40.259298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 313/617] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:40 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:40.314036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:40.314663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:40.321254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:40.321706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:40.322512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:40.322954 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:40.470021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:40.477750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bc9d1a8e-6386-467a-b2d3-83e6923e9891 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1674 microversion: 2.1 time: 0.167954 Jul 11 14:12:40.478394 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 305/618] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:40 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:41.277142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:41.277868 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:41.284931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.285380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.286202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.287103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.353749 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:41.364013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-90c9b2b7-28dc-458b-946d-2acbfa3135b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 200 len: 1614 microversion: 2.1 time: 0.090753 Jul 11 14:12:41.370409 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 314/619] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:41 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:41.413982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-666afbe5-f882-45f2-8177-821cb6fe3a60 req-9ec715f3-cb6a-40f3-9a30-e91d71108eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bf941c-f166-4236-b1dc-c7943dfa23cb", "name": "network-vif-deleted", "tag": "60d6a63c-f969-420e-97a5-2a6fcfdfeaa4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:41.426102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-666afbe5-f882-45f2-8177-821cb6fe3a60 req-9ec715f3-cb6a-40f3-9a30-e91d71108eda service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.426576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-666afbe5-f882-45f2-8177-821cb6fe3a60 req-9ec715f3-cb6a-40f3-9a30-e91d71108eda service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.438430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-666afbe5-f882-45f2-8177-821cb6fe3a60 req-9ec715f3-cb6a-40f3-9a30-e91d71108eda service nova] Creating event network-vif-deleted:60d6a63c-f969-420e-97a5-2a6fcfdfeaa4 for instance b2bf941c-f166-4236-b1dc-c7943dfa23cb on hv-cinder-84842 Jul 11 14:12:41.443609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-666afbe5-f882-45f2-8177-821cb6fe3a60 req-9ec715f3-cb6a-40f3-9a30-e91d71108eda service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Jul 11 14:12:41.444477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 306/620] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:41.495472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:41.496099 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:41.514053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.514527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.516012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.516292 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.706724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:41.715031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8b335128-acd4-4d82-ad68-da4f1d11122d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1651 microversion: 2.1 time: 0.223671 Jul 11 14:12:41.715649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 315/621] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:41 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1651 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:41.733217 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32c77d63-78bc-4400-9413-2d98783760d5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:41.740780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32c77d63-78bc-4400-9413-2d98783760d5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.741569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32c77d63-78bc-4400-9413-2d98783760d5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.807974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32c77d63-78bc-4400-9413-2d98783760d5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Going to try to start instance {{(pid=117980) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 11 14:12:41.857367 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32c77d63-78bc-4400-9413-2d98783760d5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action" status: 202 len: 0 microversion: 2.1 time: 0.128658 Jul 11 14:12:41.858887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 307/622] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:12:41 2022] POST /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:41.868157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:41.869069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:41.875892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.876401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:41.877199 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:41.877633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:42.049797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:42.057086 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e32396c6-056b-43ff-8af4-3aa28dee7cd6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1660 microversion: 2.1 time: 0.192880 Jul 11 14:12:42.057799 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 316/623] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:41 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1660 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:42.381723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:42.382653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:42.388921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:42.389633 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:42.391059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:42.391505 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:42.406608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb HTTP/1.1 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:12:42.408296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:12:42.409931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'b2bf941c-f166-4236-b1dc-c7943dfa23cb'} Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:12:42.410967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:12:42.412402 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:12:42.413732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:12:42.413732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-84adb8a4-3550-4171-b922-8720d26f8f70 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 404 len: 111 microversion: 2.1 time: 0.032364 Jul 11 14:12:42.413892 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 308/624] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:42 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:12:42.419298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fb4ac97a-1939-4172-8235-b72b9fd13ab4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '.version_select at 0x7ffad5251e50>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:42.440131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fb4ac97a-1939-4172-8235-b72b9fd13ab4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401273566" status: 202 len: 0 microversion: 2.1 time: 0.025073 Jul 11 14:12:42.444357 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 317/625] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 11 14:12:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401273566 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:42.854651 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:42.855173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:42.862085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:42.862539 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:42.863306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:42.863738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:42.887542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lazy-loading 'flavor' on Instance uuid 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:12:42.969010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5f825017-cdb2-4291-b468-dda596a83c71 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "POST /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e/action" status: 202 len: 0 microversion: 2.1 time: 0.118520 Jul 11 14:12:42.972932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 309/626] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:12:42 2022] POST /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:42.978174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:42.978852 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:42.988989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:42.989601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:42.990929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:42.991546 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:43.082088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:43.082836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:43.092318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:43.092757 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:43.093577 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:43.094014 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:43.258356 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:43.266931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1b94c7a6-5789-4b35-8f9c-1ac0560ab033 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.292483 Jul 11 14:12:43.277084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 318/627] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:42 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:43.351370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:43.359189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d19983cd-1fec-400c-9906-ef6f045a7a06 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1660 microversion: 2.1 time: 0.288646 Jul 11 14:12:43.359767 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 310/628] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:43 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1660 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:43.395473 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7a030cae-7863-4477-b563-e772e2fe381d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: .version_select at 0x7ffad52e4e50>, body: {"keypair": {"name": "tempest-keypair-1841767448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrbHHH+yeO8NOla+X1pFBT798M9ZgUiQUQDfaYP2AqxXwF0t3Gd05NyN5TBPJHXbqi5M3/ejPxuoy5SD3/UytaHi5UdajwWAqqO3EDTfWvvv5CxiM8iTxBdJr962VSgqw=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:43.410903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-7a030cae-7863-4477-b563-e772e2fe381d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:12:43.416784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-7a030cae-7863-4477-b563-e772e2fe381d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:12:43.443389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7a030cae-7863-4477-b563-e772e2fe381d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051664 Jul 11 14:12:43.449117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 319/629] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:12:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:44.285516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:44.286219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:44.294406 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:44.294862 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:44.295660 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:44.296135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:44.380790 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:44.381396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:44.388681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:44.389127 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:44.389903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:44.390355 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:44.555495 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:44.563629 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4e5212d6-2d63-4872-8e24-ef19424e374f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.282049 Jul 11 14:12:44.564219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 311/630] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:44 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:44.628511 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:44.639347 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-69bd59d7-bd70-40e9-ad65-e11a0b429481 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1664 microversion: 2.1 time: 0.262377 Jul 11 14:12:44.640614 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 320/631] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:44 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1664 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:44.878491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1080548766", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f652801d-32e3-4c8b-a676-9f89f4a15dcd"}], "security_groups": [{"name": "tempest-securitygroup--2000197969"}], "key_name": "tempest-keypair-1841767448", "user_data": "}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:44.984564 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] validate_networks() for [('f652801d-32e3-4c8b-a676-9f89f4a15dcd', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:12:45.437346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:12:45.438016 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:12:45.438274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:12:45.438723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:12:45.439165 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:12:45.448239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:45.448715 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:45.449671 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:45.449941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:45.467265 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:12:45.471453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:12:45.483954 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:12:45.486221 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:12:45.534413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-61e309c0-73bf-4cb6-9b13-330c6dd79c41 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.660265 Jul 11 14:12:45.535126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 312/632] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:12:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:12:45.545520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-64fe3284-349f-46b4-9382-7c3e48c6840d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:45.546712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-64fe3284-349f-46b4-9382-7c3e48c6840d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:45.586193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:45.587214 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:45.600491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:45.600978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:45.601844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:45.602338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:45.616936 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-64fe3284-349f-46b4-9382-7c3e48c6840d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:45.625067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-64fe3284-349f-46b4-9382-7c3e48c6840d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1242 microversion: 2.1 time: 0.083416 Jul 11 14:12:45.625815 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 321/633] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:45 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:45.759010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:45.766883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d9784969-4316-456c-8107-d6dac5afca2e tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.188724 Jul 11 14:12:45.767477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 313/634] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:45 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:46.644483 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:46.645711 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:46.653931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:46.654650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:46.655965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:46.656391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:46.729740 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:46.737684 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-17ce5a21-0454-4de0-a301-3e7a0bad7862 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1294 microversion: 2.1 time: 0.098957 Jul 11 14:12:46.738269 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 322/635] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:46 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:46.784843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:46.785465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:46.792361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:46.792806 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:46.793594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:46.794023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:46.936357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:46.945822 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-13f473e6-d915-4a92-9946-bb768425b886 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.165419 Jul 11 14:12:46.946714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 314/636] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:46 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:47.757149 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:47.757784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:47.764404 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:47.764942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:47.765736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:47.766181 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:47.917450 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:47.926925 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-69ff8410-430d-4d39-b40c-78e363c6076d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.173620 Jul 11 14:12:47.936919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 323/637] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:47 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:47.964783 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:47.965469 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:47.972163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:47.972607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:47.973374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:47.974022 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:48.122352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:48.131207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32d89e60-1bf7-408b-bbbe-85fa44590987 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.170819 Jul 11 14:12:48.131780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 315/638] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:47 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:48.398543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b928dcdf-4ccd-4cc3-9ecb-d4fbb17e06e0 req-d290fcdc-18be-47e3-8bba-73d5d4d4c3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21851a9e-91d2-4ced-87e9-abedb3c03835", "tag": "827011e5-30e0-4612-b116-50bf98ff23c7"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:48.412657 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b928dcdf-4ccd-4cc3-9ecb-d4fbb17e06e0 req-d290fcdc-18be-47e3-8bba-73d5d4d4c3d0 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:48.413104 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b928dcdf-4ccd-4cc3-9ecb-d4fbb17e06e0 req-d290fcdc-18be-47e3-8bba-73d5d4d4c3d0 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:48.427497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b928dcdf-4ccd-4cc3-9ecb-d4fbb17e06e0 req-d290fcdc-18be-47e3-8bba-73d5d4d4c3d0 service nova] Creating event network-changed:827011e5-30e0-4612-b116-50bf98ff23c7 for instance 21851a9e-91d2-4ced-87e9-abedb3c03835 on hv-cinder-84842 Jul 11 14:12:48.433236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b928dcdf-4ccd-4cc3-9ecb-d4fbb17e06e0 req-d290fcdc-18be-47e3-8bba-73d5d4d4c3d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041442 Jul 11 14:12:48.433852 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 324/639] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:48.945227 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:48.945840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:48.952512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:48.952973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:48.953732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:48.954164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:49.083653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:49.091416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-db6f01ae-a7c2-480d-8406-774b7585cd2f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.150301 Jul 11 14:12:49.091994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 316/640] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:48 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:49.149522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:49.150327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:49.157521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:49.157521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:49.158295 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:49.158760 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:49.290335 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:49.298565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ecbb20d4-da4a-453c-bcc7-a52eeb929ac5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.153168 Jul 11 14:12:49.299148 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 325/641] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:49 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:50.112370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:50.113781 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:50.126193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:50.126994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:50.127863 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:50.128341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:50.294736 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:50.310686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8f49401d-c134-4873-9318-42bc4978a6c5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.205182 Jul 11 14:12:50.312833 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 317/642] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:50 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:50.317056 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:50.318770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:50.328873 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:50.329325 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:50.330138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:50.330613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:50.472515 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:50.480482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0006933a-8ea8-4533-8492-a9fc628016a6 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.167229 Jul 11 14:12:50.480991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 326/643] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:50 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:51.338658 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:51.339244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:51.346047 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:51.346532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:51.347325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:51.347758 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:51.502085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:51.503216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:51.505095 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:51.509820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:51.510261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:51.511067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:51.511694 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:51.521193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8e0e9e67-49e1-43db-8733-9c25ae8682de tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.186464 Jul 11 14:12:51.521979 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 318/644] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:51 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:51.669825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:51.685206 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-93d6dced-48b7-4292-abe1-4e50eec6dd1c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.189163 Jul 11 14:12:51.686133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 327/645] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:51 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:52.541161 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:52.541929 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:52.544563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:52.551876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:52.552341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:52.553158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:52.553603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:52.560305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:52.703235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:52.704052 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:52.710666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:52.711105 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:52.711895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:52.712320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:52.727605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:52.735861 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bf88bbef-202a-4046-8fb6-a4f6cadc3e6a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.198680 Jul 11 14:12:52.736460 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 319/646] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:52 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:52.873536 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:52.882944 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-47086ed8-1469-403e-9356-7cbe719b8d84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.184107 Jul 11 14:12:52.883619 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 328/647] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:52 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:53.754078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:53.754878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:53.761710 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:53.762151 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:53.762960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:53.763390 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:53.904926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:53.907848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:53.919423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:53.921232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:53.923019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:53.924225 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:53.946810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:53.955509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e265d3c3-90a5-4e39-af20-7d1de33cf528 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.205976 Jul 11 14:12:53.956386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 320/648] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:53 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:54.117766 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:54.120343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:54.121136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:54.127760 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0e26f68c-73ad-468f-9ab2-2977a0c767ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.230524 Jul 11 14:12:54.128361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 329/649] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:53 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:54.129999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.130695 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.131844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.132372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.165248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-38d4b29d-7a52-4f58-917b-59140a5812be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments/678ec8e2-9787-48c6-9187-1105255d00bb" status: 200 len: 194 microversion: 2.20 time: 0.199124 Jul 11 14:12:54.165834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 321/650] 10.222.0.49 () {60 vars in 1453 bytes} [Mon Jul 11 14:12:53 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments/678ec8e2-9787-48c6-9187-1105255d00bb => generated 194 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:12:54.230894 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:54.231377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:54.237387 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.237830 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.238620 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.239099 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.370137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lazy-loading 'services' on Instance uuid 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:12:54.503247 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9e611dd5-7eb6-4f8a-97e9-cdec15c32900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments/678ec8e2-9787-48c6-9187-1105255d00bb" status: 202 len: 0 microversion: 2.20 time: 0.276219 Jul 11 14:12:54.503850 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 330/651] 10.222.0.49 () {60 vars in 1456 bytes} [Mon Jul 11 14:12:54 2022] DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments/678ec8e2-9787-48c6-9187-1105255d00bb => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:12:54.512731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:54.513747 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:54.520706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.521153 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.521931 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.522412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.556262 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-46d43e1b-cc92-45e0-a068-0fb85ad19beb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047688 Jul 11 14:12:54.557044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 322/652] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 11 14:12:54 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:12:54.973231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:54.973929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:54.976062 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:54.982214 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.982685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:54.983956 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:54.984384 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:55.147357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:55.147972 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:55.154903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:55.155399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:55.156190 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:55.156627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:55.177743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:55.187217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-664aae82-c48c-49a7-8212-3f545409a6d0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.217825 Jul 11 14:12:55.190351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 331/653] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:54 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:55.334174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:55.344573 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-60d8f583-d6e8-4183-aa37-fa65f1248c52 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.202781 Jul 11 14:12:55.345176 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 323/654] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:55 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:55.492729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-eeb372f2-85d4-498e-8f1f-88dc8c69728b req-75fa781f-65ac-4ba0-8a4c-72c3ae6bb78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21851a9e-91d2-4ced-87e9-abedb3c03835", "name": "network-vif-plugged", "status": "completed", "tag": "827011e5-30e0-4612-b116-50bf98ff23c7"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:55.507625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-eeb372f2-85d4-498e-8f1f-88dc8c69728b req-75fa781f-65ac-4ba0-8a4c-72c3ae6bb78d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:55.508332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-eeb372f2-85d4-498e-8f1f-88dc8c69728b req-75fa781f-65ac-4ba0-8a4c-72c3ae6bb78d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:55.522521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-eeb372f2-85d4-498e-8f1f-88dc8c69728b req-75fa781f-65ac-4ba0-8a4c-72c3ae6bb78d service nova] Creating event network-vif-plugged:827011e5-30e0-4612-b116-50bf98ff23c7 for instance 21851a9e-91d2-4ced-87e9-abedb3c03835 on hv-cinder-84842 Jul 11 14:12:55.527776 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-eeb372f2-85d4-498e-8f1f-88dc8c69728b req-75fa781f-65ac-4ba0-8a4c-72c3ae6bb78d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142103 Jul 11 14:12:55.528399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 332/655] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:55.569073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:55.570074 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:55.572380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:55.573064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:55.580614 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:55.581057 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:55.581860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:55.582292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:55.615612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-25852901-810c-45f5-8b31-7d877231b7b5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050574 Jul 11 14:12:55.616201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 324/656] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 11 14:12:55 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 11 14:12:56.219153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:56.220565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:56.227702 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:56.235443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:56.235918 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:56.236979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:56.237429 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:56.265970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:12:56.367073 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:56.367891 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:56.375576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:56.376546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:56.378121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:56.379174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:56.488645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:56.498601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4e89aa80-cf01-4320-a7aa-e990e9c977cb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.289072 Jul 11 14:12:56.499249 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 333/657] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:56 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:56.559512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:56.567558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bdc7ed3c-a45e-4292-8205-55b96a9cf9b9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.205302 Jul 11 14:12:56.568149 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 325/658] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:56 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:56.628880 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:56.629713 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:56.635922 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:56.636376 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:56.637150 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:56.637594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:56.668471 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-44f6c7a3-4f2d-495b-ab4d-44943c406318 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043964 Jul 11 14:12:56.669175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 334/659] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 11 14:12:56 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:12:57.515507 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:57.516141 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.522678 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.523130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.523897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.524334 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.585009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:57.585754 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.591792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.592234 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.593489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.593919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.697895 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:57.705540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bb636182-7f61-4406-bbe6-25bc21d27e0f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1368 microversion: 2.1 time: 0.193825 Jul 11 14:12:57.706343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 326/660] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:57 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:57.710837 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:57.711738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.718404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.719120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.719987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.720415 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.745153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:57.751695 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e73103ea-0a32-4671-aad9-8fa0f5d6cb2e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044390 Jul 11 14:12:57.752576 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 327/661] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 11 14:12:57 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:57.755118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-db6dd57f-188f-4fcb-af2e-bd31410376e1 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1571 microversion: 2.1 time: 0.173938 Jul 11 14:12:57.755685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 335/662] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:57 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:57.771469 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:57.771962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.778234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.778726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.779509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.780446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.817582 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:57.818631 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.824805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.825243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.826008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.826463 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.866413 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:12:57.867468 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9900dc85-7b29-4f7d-a9dc-1b96292f804c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "POST /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e/action" status: 202 len: 0 microversion: 2.1 time: 0.099766 Jul 11 14:12:57.868097 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 328/663] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:12:57 2022] POST /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:12:57.876713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:57.877459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.884178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.884722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.885577 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.886079 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.955892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f95714ae-082b-4e6a-9be6-1b1c2dd9a932 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 204 len: 0 microversion: 2.20 time: 0.141970 Jul 11 14:12:57.956804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 336/664] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 11 14:12:57 2022] DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 11 14:12:57.965716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:57.966442 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:57.973095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.973572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:57.974599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:57.974765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:58.158844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:58.167216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1717d1ee-ab42-48bb-ae05-4ba2bb6b811c tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1579 microversion: 2.1 time: 0.294739 Jul 11 14:12:58.168136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 329/665] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:57 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1579 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:12:58.198232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:58.214174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:58.217599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:58.220018 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a6eb044f-3593-4c6f-a996-989bdddac639 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.258288 Jul 11 14:12:58.221350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 337/666] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:12:57 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:12:58.723076 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:58.723685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:58.730167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:58.730626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:58.731387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:58.731816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:58.859467 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:58.866939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-588d77c0-c429-436c-a7be-208649a5b9bc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1558 microversion: 2.1 time: 0.147718 Jul 11 14:12:58.867502 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 330/667] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:58 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:58.883548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:58.884050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:58.890273 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:58.890769 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:58.891673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:58.892109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:58.967157 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f250f7dc-10cf-4c9c-8a23-24838d6dca06 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087411 Jul 11 14:12:58.967770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 338/668] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:12:58 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:12:59.185343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:59.185972 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:59.192268 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:59.192790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:59.193542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:59.193966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:59.239928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:12:59.240440 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:12:59.246853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:59.247302 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:59.248083 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:59.248513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:59.543688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:59.552270 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-be1676a9-0aa3-4358-9ca2-dd43016ee989 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1519 microversion: 2.1 time: 0.370806 Jul 11 14:12:59.552433 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:59.563044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 331/669] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:12:59 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:12:59.563044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-104ee487-a689-4e91-96db-785aa7b57c52 req-6d243e13-be0b-4530-8292-289cf269b4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "name": "network-vif-unplugged", "status": "completed", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:12:59.566700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-104ee487-a689-4e91-96db-785aa7b57c52 req-6d243e13-be0b-4530-8292-289cf269b4db service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:12:59.567292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-104ee487-a689-4e91-96db-785aa7b57c52 req-6d243e13-be0b-4530-8292-289cf269b4db service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:12:59.570223 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:59.571866 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:12:59.573024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-13f7c419-cece-4e21-970f-f4d775b321ff tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.337171 Jul 11 14:12:59.573766 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 339/670] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:12:59 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:12:59.580742 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.compute.server_external_events [req-104ee487-a689-4e91-96db-785aa7b57c52 req-6d243e13-be0b-4530-8292-289cf269b4db service nova] Unable to find a host for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e. Dropping event network-vif-unplugged {{(pid=117980) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 11 14:12:59.581638 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-104ee487-a689-4e91-96db-785aa7b57c52 req-6d243e13-be0b-4530-8292-289cf269b4db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027741 Jul 11 14:12:59.582240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 332/671] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 11 14:13:00.393834 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-ecbfcafb-36bd-4f70-9374-1565d72d21dc req-bdd07e2d-0659-48ea-8c05-5edba25e2fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21851a9e-91d2-4ced-87e9-abedb3c03835", "tag": "827011e5-30e0-4612-b116-50bf98ff23c7"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:00.405786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ecbfcafb-36bd-4f70-9374-1565d72d21dc req-bdd07e2d-0659-48ea-8c05-5edba25e2fde service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:00.406457 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ecbfcafb-36bd-4f70-9374-1565d72d21dc req-bdd07e2d-0659-48ea-8c05-5edba25e2fde service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:00.420862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-ecbfcafb-36bd-4f70-9374-1565d72d21dc req-bdd07e2d-0659-48ea-8c05-5edba25e2fde service nova] Creating event network-changed:827011e5-30e0-4612-b116-50bf98ff23c7 for instance 21851a9e-91d2-4ced-87e9-abedb3c03835 on hv-cinder-84842 Jul 11 14:13:00.429495 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-ecbfcafb-36bd-4f70-9374-1565d72d21dc req-bdd07e2d-0659-48ea-8c05-5edba25e2fde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105029 Jul 11 14:13:00.430455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 340/672] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:00.570574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:00.571213 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:00.578701 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:00.579144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:00.579921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:00.580352 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:00.591822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:00.593024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:00.600528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:00.600968 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:00.601735 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:00.602165 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:00.801191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:00.808835 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bee358ed-3c9f-4e34-886f-0ceb2d832926 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1521 microversion: 2.1 time: 0.242080 Jul 11 14:13:00.816606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:00.819120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 333/673] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:00 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:00.830833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:00.832650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:00.834182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-31109dfb-bf3b-4385-a275-b1a54468de1b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.246574 Jul 11 14:13:00.834940 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 341/674] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:00 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:13:01.830174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:01.830798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:01.837566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:01.838006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:01.838799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:01.839233 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:01.854544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:01.855240 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:01.862226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:01.868054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:01.868054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:01.868054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:02.072447 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:02.083198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-029ac098-c322-4ff5-a521-1277318e0505 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.260317 Jul 11 14:13:02.088787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:02.093945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 334/675] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:01 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:02.099788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:02.101493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:02.102811 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8e38df32-4faf-422e-98e1-0f276665d9a9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1722 microversion: 2.20 time: 0.252574 Jul 11 14:13:02.103463 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 342/676] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:01 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:13:02.897191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-855b39a1-c599-4a50-bf99-1ef3a7b378ac req-e4943490-50d0-4865-a765-7cfc99f461c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6b4651-c65b-40b8-bcf6-e27e6274ef5d", "name": "network-vif-deleted", "tag": "448bcd1b-bd2c-4771-974b-0259ecbcd6e4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:02.906719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-855b39a1-c599-4a50-bf99-1ef3a7b378ac req-e4943490-50d0-4865-a765-7cfc99f461c7 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:02.907167 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-855b39a1-c599-4a50-bf99-1ef3a7b378ac req-e4943490-50d0-4865-a765-7cfc99f461c7 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:02.918214 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-855b39a1-c599-4a50-bf99-1ef3a7b378ac req-e4943490-50d0-4865-a765-7cfc99f461c7 service nova] Creating event network-vif-deleted:448bcd1b-bd2c-4771-974b-0259ecbcd6e4 for instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d on hv-cinder-84842 Jul 11 14:13:02.923311 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-855b39a1-c599-4a50-bf99-1ef3a7b378ac req-e4943490-50d0-4865-a765-7cfc99f461c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030214 Jul 11 14:13:02.923907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 335/677] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:03.101595 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:03.103038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:03.110103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:03.110957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:03.112403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:03.116479 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:03.125909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:03.131056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:03.153315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:03.153754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:03.154810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:03.155396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:03.237676 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:03.358228 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:03.369515 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:03.373278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:03.374599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a3f26989-3d3b-4da8-ac44-f5d9510bc686 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1365 microversion: 2.20 time: 0.256777 Jul 11 14:13:03.378038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 336/678] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:03 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:13:03.402696 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:03.413750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-45a2bdca-2a42-457c-949c-bc81a353f4d4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.316143 Jul 11 14:13:03.414968 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 343/679] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:03 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:04.395147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:04.395748 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:04.402275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:04.402739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:04.403500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:04.403927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:04.432563 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:04.433813 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:04.437436 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:04.437886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:04.438361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lazy-loading 'fault' on Instance uuid 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:13:04.439853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:04.440291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:04.441058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:04.441484 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:04.494457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:04.503239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:04.504751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:04.506172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2ee9f6ee-3900-48be-9a45-ba76f29590a0 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 200 len: 1370 microversion: 2.20 time: 0.114882 Jul 11 14:13:04.506774 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 337/680] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:04 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 1370 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:04.589528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:04.597088 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-746319f5-9343-451f-8bda-9b72eb31daf3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.168331 Jul 11 14:13:04.597666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 344/681] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:04 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:05.524293 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:05.524896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:05.531238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:05.531683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:05.532448 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:05.532883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:05.549345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] HTTP exception thrown: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Request method failure captured: Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d HTTP/1.1 Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Lj5Bq_7SXFNnnMs4rgxiHxac0pFz7E0VgjQo7DNjvb58_PKVe89iwIbZ4xkdGiARqj3e-EBd5iT_qFrs6LbJcsushIy6VGrbOcNEZFKayCpBXhKeEbsDhwlDrJGsVb88ifjijTNS0e1gFWvWdRLyGd1jvD7qt1jswjGRR3koAkQo Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:13:05.551304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_beef80716d254a03a5e673b9cfd781ce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}] Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 98143abd2e3c47e3921184a1c5e05a89 Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:13:05.553015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '4b6b4651-c65b-40b8-bcf6-e27e6274ef5d'} Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:05.553886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:13:05.555342 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:05.556876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Returning 404 to user: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:05.556876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0e7f1082-1428-421a-887b-426cba80f5d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 404 len: 111 microversion: 2.20 time: 0.032343 Jul 11 14:13:05.556876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 338/682] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:05 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:13:05.562488 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fb8cf54a-6430-4a09-9b7b-ed59de907617 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '.version_select at 0x7ffad5294280>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:05.579310 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fb8cf54a-6430-4a09-9b7b-ed59de907617 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309688238" status: 204 len: 0 microversion: 2.20 time: 0.021236 Jul 11 14:13:05.579886 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 345/683] 10.222.0.49 () {60 vars in 1258 bytes} [Mon Jul 11 14:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309688238 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:13:05.614927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:05.615541 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:05.621794 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:05.622231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:05.623041 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:05.624065 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:05.800862 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:05.809349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6462d61a-8e31-48fa-8353-fd8d58a42937 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.198245 Jul 11 14:13:05.809936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 339/684] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:05 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:06.552821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-61ea589d-263c-435e-9242-1f72f48f71b2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'create', calling method: .version_select at 0x7ffad51a1af0>, body: {"keypair": {"name": "tempest-keypair-2125289354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCho5ymJJSn+ByAEpxvSMFUO4wYMF3NqpPX3/v6CBxles//2WEoxC039iHZKWRR7hiKjvWeZdkiOWAM1C2VfkvyopsaxgM0P4vjrlQSnkO1QTCpAxjacXNWAgHXeZp/24Q=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:06.567712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-61ea589d-263c-435e-9242-1f72f48f71b2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for project beef80716d254a03a5e673b9cfd781ce. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:06.571858 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-61ea589d-263c-435e-9242-1f72f48f71b2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for user 98143abd2e3c47e3921184a1c5e05a89 and project beef80716d254a03a5e673b9cfd781ce. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:06.595492 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-61ea589d-263c-435e-9242-1f72f48f71b2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047016 Jul 11 14:13:06.596150 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 346/685] 10.222.0.49 () {62 vars in 1199 bytes} [Mon Jul 11 14:13:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 11 14:13:06.833266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:06.834027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:06.842136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:06.842995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:06.844216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:06.844743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:07.028986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:07.044696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c766adf2-e1a4-40ab-8c72-5a4a1020b9e4 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.214839 Jul 11 14:13:07.048081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 340/686] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:06 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:07.887206 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1410094847", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a75a9f7a-5a4f-4c63-9c13-4bda5fe5b2fe"}], "security_groups": [{"name": "tempest-securitygroup--860965404"}], "key_name": "tempest-keypair-2125289354", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:07.994765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] validate_networks() for [('a75a9f7a-5a4f-4c63-9c13-4bda5fe5b2fe', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:13:08.072083 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:08.072746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:08.079489 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:08.079942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:08.080719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:08.081155 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:08.256551 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:08.265101 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8895007c-9587-49c6-8ab5-076bb1b5f153 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.197017 Jul 11 14:13:08.265674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 341/687] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:08 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:08.456272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:13:08.456699 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:13:08.457179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:13:08.457589 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:13:08.458001 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:13:08.466709 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:08.467798 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:08.468607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:08.469041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:08.485191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for project beef80716d254a03a5e673b9cfd781ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:08.489163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Getting quotas for user 98143abd2e3c47e3921184a1c5e05a89 and project beef80716d254a03a5e673b9cfd781ce. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:08.499954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:13:08.502172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:13:08.548444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-93aa2fc5-6b3a-47ed-9498-a0b887110e06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.667676 Jul 11 14:13:08.549144 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 347/688] 10.222.0.49 () {62 vars in 1187 bytes} [Mon Jul 11 14:13:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 11 14:13:08.559473 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4b9dd3fa-85ee-49c9-adab-c676ad757927 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:08.560076 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4b9dd3fa-85ee-49c9-adab-c676ad757927 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:08.612501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b9dd3fa-85ee-49c9-adab-c676ad757927 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:08.619753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b9dd3fa-85ee-49c9-adab-c676ad757927 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:08.621303 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4b9dd3fa-85ee-49c9-adab-c676ad757927 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:08.622416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4b9dd3fa-85ee-49c9-adab-c676ad757927 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1282 microversion: 2.20 time: 0.066935 Jul 11 14:13:08.622958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 342/689] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:08 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:13:09.282405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:09.283002 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:09.289919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:09.290405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:09.291174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:09.291623 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:09.426900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:09.435027 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7ea9d133-1fb5-4d03-bf62-b6bffd5e38bc tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.156681 Jul 11 14:13:09.435627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 348/690] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:09 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:09.640878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:09.641878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:09.648248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:09.648698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:09.649481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:09.649922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:09.714157 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:09.722778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:09.724292 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:09.725395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-edff167e-b9ef-40b8-81f0-3530e66be96f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1352 microversion: 2.20 time: 0.088587 Jul 11 14:13:09.726100 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 343/691] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:09 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:10.452556 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:10.453175 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:10.459449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:10.459906 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:10.460683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:10.461121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:10.593916 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:10.601714 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e3cdba30-55ea-4804-be0f-fa039ee155ab tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.153106 Jul 11 14:13:10.602290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 349/692] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:10 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:10.744296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:10.744897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:10.751326 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:10.751770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:10.752517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:10.752946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:10.883585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:10.893072 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:10.894831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:10.896033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1bfdd4ee-e84c-4214-86b6-a6df418c6b59 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.155750 Jul 11 14:13:10.896654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 344/693] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:10 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:11.618902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:11.619520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:11.625591 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:11.626038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:11.626835 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:11.627271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:11.770012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:11.777621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8bc800e6-760a-4c04-ae3f-5b138b1dc012 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.162527 Jul 11 14:13:11.778244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 350/694] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:11 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:11.915750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:11.917072 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:11.924270 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:11.924753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:11.925812 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:11.926457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:12.065491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:12.074440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:12.075974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:12.078094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bfb84230-9f1a-4bb5-a51d-9a1e85251bc4 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.167125 Jul 11 14:13:12.088209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 345/695] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:11 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:12.136731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-ba080a22-3a4c-4588-abd6-d74cde69febe req-32e597c9-3eff-4afc-83c3-89482d75fd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:12.145603 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ba080a22-3a4c-4588-abd6-d74cde69febe req-32e597c9-3eff-4afc-83c3-89482d75fd98 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:12.146050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ba080a22-3a4c-4588-abd6-d74cde69febe req-32e597c9-3eff-4afc-83c3-89482d75fd98 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:12.158544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-ba080a22-3a4c-4588-abd6-d74cde69febe req-32e597c9-3eff-4afc-83c3-89482d75fd98 service nova] Creating event network-changed:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:13:12.164192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-ba080a22-3a4c-4588-abd6-d74cde69febe req-32e597c9-3eff-4afc-83c3-89482d75fd98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031611 Jul 11 14:13:12.165174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 351/696] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:12.794856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:12.796012 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:12.802347 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:12.802799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:12.803555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:12.803991 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:12.937289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:12.944835 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5b5667be-3043-48b4-ab04-dba44da592b5 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.153919 Jul 11 14:13:12.945401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 346/697] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:12 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:13.096469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:13.097187 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:13.103650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:13.104091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:13.104848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:13.105283 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:13.231226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:13.235250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:13.240615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:13.242111 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:13.243228 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-74a60fd9-fa1f-4085-a2c4-4af0378ebf93 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.151057 Jul 11 14:13:13.243786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 352/698] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:13 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:13.964048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:13.964724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:13.973530 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:13.973976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:13.974921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:13.975465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.112008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:14.119624 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b709ecb4-9e29-4e0c-83e2-f11f621ac63f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.160796 Jul 11 14:13:14.120179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 347/699] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:13 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:14.261010 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:14.261691 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:14.273908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:14.273908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.273908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:14.273908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.287510 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:14.288035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:14.294663 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:14.295120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.295900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:14.296346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.387674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lazy-loading 'services' on Instance uuid 0562d881-0ee4-4314-ad52-5a3ab9b17bcf {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:13:14.418162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:14.427020 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:14.428764 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:14.429865 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-69939249-e007-45f0-8b8c-9e5c7e96068f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.172804 Jul 11 14:13:14.430759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 353/700] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:14 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:14.464664 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aa2a3e20-13f1-43cc-9255-1221ae719c82 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments/a5823094-7686-48da-95d0-8047c35679dc" status: 202 len: 0 microversion: 2.1 time: 0.182594 Jul 11 14:13:14.465250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 348/701] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:13:14 2022] DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments/a5823094-7686-48da-95d0-8047c35679dc => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:13:14.473415 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:14.474349 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:14.480411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:14.480792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.481544 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:14.482050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:14.511513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f39f10cf-d814-4842-a4d2-b62c81522137 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041972 Jul 11 14:13:14.512061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 354/702] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:14 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:15.138280 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:15.139620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:15.146093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.146581 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.147353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.147789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.279338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:15.288237 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a7cfc1db-db40-4750-a940-5b5adadea51a tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.154706 Jul 11 14:13:15.288816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 349/703] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:15 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:15.448360 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:15.448953 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:15.455391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.455833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.456577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.457004 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.523415 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:15.524445 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:15.531346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.531795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.535459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.535936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.566827 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-636174ef-f065-4e1d-ba11-5a8628fd16ce tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047393 Jul 11 14:13:15.567412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 350/704] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:15 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:15.587448 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:15.596601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:15.598290 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:15.599561 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-90607983-113e-4137-9cf2-62fd9398bc87 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.155068 Jul 11 14:13:15.610366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 355/705] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:15 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:15.848693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8a6946a6-353c-436f-81c5-30edab2a434c req-1366083c-d085-4652-ba21-7d304c9407ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "name": "network-vif-plugged", "status": "completed", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:15.858198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8a6946a6-353c-436f-81c5-30edab2a434c req-1366083c-d085-4652-ba21-7d304c9407ef service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:15.858682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8a6946a6-353c-436f-81c5-30edab2a434c req-1366083c-d085-4652-ba21-7d304c9407ef service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:15.870692 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8a6946a6-353c-436f-81c5-30edab2a434c req-1366083c-d085-4652-ba21-7d304c9407ef service nova] Creating event network-vif-plugged:4376997e-3ed7-4f63-b17e-1d9f27589ff4 for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e on hv-cinder-84842 Jul 11 14:13:15.876026 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8a6946a6-353c-436f-81c5-30edab2a434c req-1366083c-d085-4652-ba21-7d304c9407ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031115 Jul 11 14:13:15.876628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 351/706] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:16.305095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:16.305717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:16.312336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:16.312800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:16.314137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:16.314137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:16.449745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:16.457424 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2a10aafe-e166-40f3-ba78-0c61d1907540 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.156111 Jul 11 14:13:16.458005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 356/707] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:16 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:16.581097 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:16.582140 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:16.589679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:16.590899 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:16.591017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:16.591449 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:16.617372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:16.618895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:16.623254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ede25df9-c9e7-45f2-a8cc-de65e7d39db3 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Jul 11 14:13:16.623871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 352/708] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:16 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:16.631513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:16.631962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:16.632870 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:16.633246 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:16.772882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:16.781449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:16.782972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:16.784100 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9044210e-fda4-4f59-ad54-14c592c7b724 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.170665 Jul 11 14:13:16.784649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 357/709] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:16 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:13:17.475615 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.476222 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:17.482354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.482809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.483569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.484008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.614627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:17.622162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cb7a2ec6-7a52-470a-a8b6-5e078e7068fd tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.150592 Jul 11 14:13:17.622752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 353/710] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:17 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:17.636271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.636271 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:17.642722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.643173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.643929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.644364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.672473 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-46444237-46ac-4aa3-89c1-4e1270fb14d0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040856 Jul 11 14:13:17.673015 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 358/711] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:17 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:13:17.745446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.745945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:17.752281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.752727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.753501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.753938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.758542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:17.783366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:13:17.808456 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.809182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:17.816314 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.816864 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.817728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.818242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.884647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-84414064-4e51-42f6-8d7b-2f04256b6d7a tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 204 len: 0 microversion: 2.1 time: 0.142927 Jul 11 14:13:17.888445 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 354/712] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:13:17 2022] DELETE /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:13:17.894897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:17.895602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:17.901690 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.904485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:17.904485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:17.904485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:18.008929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:18.020500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:18.022770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:18.024129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4bc533c2-63d5-40a8-b5dc-2f1d1a4c31f6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.220939 Jul 11 14:13:18.024757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 359/713] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:17 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:18.062094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:18.069762 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7ab418f8-7967-4811-8e67-36c1b722119b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1688 microversion: 2.1 time: 0.179532 Jul 11 14:13:18.078083 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 355/714] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:17 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:18.640024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:18.640629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:18.642495 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:18.643148 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=10 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:18.648035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:18.648497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:18.649264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:18.649695 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:18.780523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:18.788113 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a66d175-3411-4f6e-9ace-ec3bae936d40 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.152661 Jul 11 14:13:18.788681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 360/715] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:18 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:19.042745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:19.043354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:19.045817 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:19.051921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:19.052373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:19.053155 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:19.053596 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:19.086468 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:19.087082 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:19.094039 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:19.094647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:19.095441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:19.095873 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:19.234610 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:19.242620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:19.244130 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:19.245246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3a718cfd-50fd-42a5-a29d-c5de04f7f261 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.206407 Jul 11 14:13:19.245808 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 356/716] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:19 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:19.261132 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:19.268576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-963d50c5-5df8-4a6d-abd1-5092fe91a9a5 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1688 microversion: 2.1 time: 0.185807 Jul 11 14:13:19.269171 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 361/717] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:19 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:19.805454 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:19.806067 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:19.812863 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:19.813308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:19.814072 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:19.814590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:19.952815 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:19.962827 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bb9dd8be-3e5c-433a-b5c7-c233e0a6c4d3 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.161257 Jul 11 14:13:19.963424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 357/718] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:19 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:20.070024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-954da109-bf5d-45f5-83da-2278a684ca28 req-8442ca90-a39c-4aae-be5f-f0cc82f91f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "name": "network-vif-plugged", "status": "completed", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:20.079228 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-954da109-bf5d-45f5-83da-2278a684ca28 req-8442ca90-a39c-4aae-be5f-f0cc82f91f69 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.079620 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-954da109-bf5d-45f5-83da-2278a684ca28 req-8442ca90-a39c-4aae-be5f-f0cc82f91f69 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:20.092497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-954da109-bf5d-45f5-83da-2278a684ca28 req-8442ca90-a39c-4aae-be5f-f0cc82f91f69 service nova] Creating event network-vif-plugged:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:13:20.097475 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-954da109-bf5d-45f5-83da-2278a684ca28 req-8442ca90-a39c-4aae-be5f-f0cc82f91f69 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 Jul 11 14:13:20.098189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 362/719] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:20.264553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:20.265146 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:20.271729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.272184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:20.272956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.273400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:20.285896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:20.286549 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:20.292667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.293118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:20.293882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.294369 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:20.471910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:20.472230 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:20.479996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c83b854c-4fdd-433c-a896-f476b240e55b tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1688 microversion: 2.1 time: 0.198297 Jul 11 14:13:20.480225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:20.480565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 363/720] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:20 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:20.481729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:20.483363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f92c10e4-bde5-4242-aa24-7d556b112858 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.223343 Jul 11 14:13:20.483916 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 358/721] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:20 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:20.980340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:20.980868 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:20.982912 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:20.988062 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.988516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:20.989285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:20.989718 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:21.121982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:21.130035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-335b9945-cc51-4b2f-81af-2311a26a10c2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1577 microversion: 2.1 time: 0.153645 Jul 11 14:13:21.130629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 364/722] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:20 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:21.500481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:21.501082 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:21.501619 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:21.502239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:21.508288 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:21.508469 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:21.508741 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:21.508858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:21.509518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:21.509689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:21.509962 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:21.510187 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:21.708668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:21.712567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:21.721460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:21.721858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bbb52504-022c-4c1d-9676-ce7831643560 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1688 microversion: 2.1 time: 0.226876 Jul 11 14:13:21.722479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 359/723] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:21 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:21.723227 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:21.724411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-22ded2b3-3f8a-414e-a980-181782c70ebc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.227381 Jul 11 14:13:21.725068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 365/724] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:21 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:13:22.147801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:22.148413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:22.154902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:22.155354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:22.156126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:22.156564 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:22.286064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:22.293581 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-36b6147b-aff5-420c-a3f7-b9127995040f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1564 microversion: 2.1 time: 0.149754 Jul 11 14:13:22.294152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 360/725] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:22 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:22.739400 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:22.740070 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:22.742602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:22.743819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:22.746035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:22.746516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:22.747484 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:22.747612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:22.748730 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:22.752299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:22.752748 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:22.753553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:22.753988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:22.974913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:22.977622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:22.987399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bac26e8c-85a6-4182-bf6e-5b4e3fab6e0c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1688 microversion: 2.1 time: 0.251963 Jul 11 14:13:22.988363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:22.990768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:22.991914 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-55d46e11-19a2-4231-8c84-dbb5bf36083d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.253161 Jul 11 14:13:22.992475 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 361/726] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:22 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:22.997396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 366/727] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:22 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:23.237195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-d63b66da-a8b8-4048-8fae-b4a78ac7c38f req-2575c747-8d2d-4df7-bcb3-901779c9737a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0562d881-0ee4-4314-ad52-5a3ab9b17bcf", "name": "network-vif-deleted", "tag": "0a982454-2ed0-4dd2-bc29-6243369d5594"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:23.245212 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-d63b66da-a8b8-4048-8fae-b4a78ac7c38f req-2575c747-8d2d-4df7-bcb3-901779c9737a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:23.245648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-d63b66da-a8b8-4048-8fae-b4a78ac7c38f req-2575c747-8d2d-4df7-bcb3-901779c9737a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:23.256684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-d63b66da-a8b8-4048-8fae-b4a78ac7c38f req-2575c747-8d2d-4df7-bcb3-901779c9737a service nova] Creating event network-vif-deleted:0a982454-2ed0-4dd2-bc29-6243369d5594 for instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf on hv-cinder-84842 Jul 11 14:13:23.261645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-d63b66da-a8b8-4048-8fae-b4a78ac7c38f req-2575c747-8d2d-4df7-bcb3-901779c9737a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028241 Jul 11 14:13:23.262244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 362/728] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:23.294272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-25450280"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:23.295443 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:23.301881 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:23.302350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:23.303125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:23.303567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:23.694808 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.network.security_group_api [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Removing security group fdea2c5a-b313-418d-8a38-0ec70ae96512 from port 1a67ea54-5ffe-4602-930f-febfe4f1c871 Jul 11 14:13:24.006518 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:24.008226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:24.018090 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:24.018545 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:24.019331 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:24.019772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:24.062568 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:24.063058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:24.063934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lazy-loading 'fault' on Instance uuid 0562d881-0ee4-4314-ad52-5a3ab9b17bcf {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:13:24.067819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9620aab4-4898-4b44-88cb-dc056039344e tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/action" status: 202 len: 0 microversion: 2.1 time: 0.776800 Jul 11 14:13:24.070160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 367/729] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Jul 11 14:13:23 2022] POST /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:13:24.076876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:24.077658 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:24.085869 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:24.093009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:24.094705 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:24.095521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:24.153717 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:24.171569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b7936e50-7a8e-4cb6-ac43-cb191c100f64 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 200 len: 1333 microversion: 2.1 time: 0.170590 Jul 11 14:13:24.172906 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 363/730] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:23 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 1333 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:24.178662 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-780821b3-b136-4f42-800d-8fdeb05dcca0 req-2f4d0dc3-0051-4899-9fa3-b1db9116a0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:24.187386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-780821b3-b136-4f42-800d-8fdeb05dcca0 req-2f4d0dc3-0051-4899-9fa3-b1db9116a0e9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:24.188433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-780821b3-b136-4f42-800d-8fdeb05dcca0 req-2f4d0dc3-0051-4899-9fa3-b1db9116a0e9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:24.201336 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-780821b3-b136-4f42-800d-8fdeb05dcca0 req-2f4d0dc3-0051-4899-9fa3-b1db9116a0e9 service nova] Creating event network-changed:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:13:24.207708 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-780821b3-b136-4f42-800d-8fdeb05dcca0 req-2f4d0dc3-0051-4899-9fa3-b1db9116a0e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Jul 11 14:13:24.209157 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 364/731] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:24.331418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:24.339851 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:24.341502 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:24.343251 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-445af2b1-c861-4041-a8a4-a8d689fcea45 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1407 microversion: 2.20 time: 0.271297 Jul 11 14:13:24.344053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 368/732] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:24 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:25.190120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.190847 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 0562d881-0ee4-4314-ad52-5a3ab9b17bcf] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:25.197324 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.197774 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.198575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.199227 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.214365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] HTTP exception thrown: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf could not be found. Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Request method failure captured: Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf HTTP/1.1 Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Fsgmr1WTgQMKE5hZq2R64VsT0RCNwaHcoEocjE6DVCgURtIa0Bcl1Q2PVcJyb5htuG_AlChwJobYgN43aTlJwZLRkIhueXYPWK8UtUHtsY5wR57LfgWYKdNGbi-dwY2UFbve_MPkoFxtLHNT1hA3eEMvpjHNo1hoXRH3M7As_Cuc Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:13:25.216033 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b181bc391914f6abcea09b894b88473", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b181bc391914f6abcea09b894b88473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}] Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: cf6cc756845148ee8fce9021425cb7cb Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf could not be found. Jul 11 14:13:25.218548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '0562d881-0ee4-4314-ad52-5a3ab9b17bcf'} Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf could not be found. Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:25.219506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf could not be found. Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf could not be found. Jul 11 14:13:25.220993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:25.223309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Returning 404 to user: Instance 0562d881-0ee4-4314-ad52-5a3ab9b17bcf could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:25.223309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dcb06ea6-9a57-4098-9c18-ad8c8cd4d30c tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf" status: 404 len: 111 microversion: 2.1 time: 0.032751 Jul 11 14:13:25.223309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 365/733] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/servers/0562d881-0ee4-4314-ad52-5a3ab9b17bcf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:25.226774 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4636d86e-a45f-4c40-be8d-a5ac70d24140 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '.version_select at 0x7ffad514de50>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.244817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4636d86e-a45f-4c40-be8d-a5ac70d24140 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498811240" status: 202 len: 0 microversion: 2.1 time: 0.021682 Jul 11 14:13:25.245364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 369/734] 10.222.0.49 () {58 vars in 1217 bytes} [Mon Jul 11 14:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498811240 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:13:25.361197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.361811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:25.368111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.368551 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.369545 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.370159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.543564 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:25.554348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:25.556268 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:25.557400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-af1b7f8e-04da-4168-ba29-c405d269c1dd tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1599 microversion: 2.20 time: 0.200227 Jul 11 14:13:25.558878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 366/735] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:13:25.578208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.578848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:25.585583 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.586046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.586927 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.587438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.666162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-407b86b0-d134-479b-bb9b-65ae615007d1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093011 Jul 11 14:13:25.666793 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 370/736] 10.222.0.49 () {60 vars in 1315 bytes} [Mon Jul 11 14:13:25 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:13:25.973017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:25.973506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:25.982696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.983501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:25.987115 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:25.987560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.078284 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-ad194359-70db-4fc2-84f6-1b876c287b6a req-17416db6-4bc0-42c2-a9ba-462d2a5d7448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:26.093115 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ad194359-70db-4fc2-84f6-1b876c287b6a req-17416db6-4bc0-42c2-a9ba-462d2a5d7448 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:26.096176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ad194359-70db-4fc2-84f6-1b876c287b6a req-17416db6-4bc0-42c2-a9ba-462d2a5d7448 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.116189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lazy-loading 'services' on Instance uuid 49e8b055-46fd-4044-86cb-58e7594e0893 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:13:26.123958 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-ad194359-70db-4fc2-84f6-1b876c287b6a req-17416db6-4bc0-42c2-a9ba-462d2a5d7448 service nova] Creating event network-changed:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:13:26.138498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-ad194359-70db-4fc2-84f6-1b876c287b6a req-17416db6-4bc0-42c2-a9ba-462d2a5d7448 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069613 Jul 11 14:13:26.143981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 371/737] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:26.230953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3019119c-965c-4a7a-b5ac-45517ef659ea tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments/55179916-ff43-4924-b451-2981649a7293" status: 202 len: 0 microversion: 2.1 time: 0.260876 Jul 11 14:13:26.233399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 367/738] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:13:25 2022] DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments/55179916-ff43-4924-b451-2981649a7293 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:13:26.247378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:26.252332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:26.269371 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:26.270186 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.271242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:26.271753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.330572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:26.344361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ad555e4b-87f6-4c2a-8365-89ad05d2ea45 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105903 Jul 11 14:13:26.349153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 372/739] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:26 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:26.750455 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8947c9a5-4a48-4450-84d9-000a53b69700 req-e324efb1-d959-41c7-a8ff-2aebf614df3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:26.760430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8947c9a5-4a48-4450-84d9-000a53b69700 req-e324efb1-d959-41c7-a8ff-2aebf614df3a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:26.761044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8947c9a5-4a48-4450-84d9-000a53b69700 req-e324efb1-d959-41c7-a8ff-2aebf614df3a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:26.773351 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8947c9a5-4a48-4450-84d9-000a53b69700 req-e324efb1-d959-41c7-a8ff-2aebf614df3a service nova] Creating event network-changed:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:13:26.778631 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8947c9a5-4a48-4450-84d9-000a53b69700 req-e324efb1-d959-41c7-a8ff-2aebf614df3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033542 Jul 11 14:13:26.779401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 368/740] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:27.356914 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:27.358406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:27.364377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:27.364832 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:27.365603 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:27.366042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:27.398384 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c16a7026-edac-4349-b9f2-244819a17797 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Jul 11 14:13:27.399829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 373/741] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:27 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:28.411234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:28.412251 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:28.418466 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.418910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.419665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.420089 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.447891 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-256f3cf2-eb96-45e2-b3f9-3dfba1e9f318 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041503 Jul 11 14:13:28.448432 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 369/742] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:28 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:13:28.458813 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:28.459325 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:28.465239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.465683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.466507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.466945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.541198 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] HTTP exception thrown: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 is not attached to volume 55179916-ff43-4924-b451-2981649a7293 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Request method failure captured: Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments/55179916-ff43-4924-b451-2981649a7293 HTTP/1.1 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC77P4ad7t27_UHhXYEW82BUDnge5tI_kGJayETDJUXj5ZkI0HHQqVecafqsV7gZ0u-oy3XDIJKyT9XaEUnjHzJzlL7S2khYXGj0NpfVaW7MFo1is_1b07coS55aU1NkPbyOF0btujol_GY9iPf0orPry9QqdFIziDL7LV9v-_klPMM Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 32353b01d57e434eafdb5f253517ef93 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestMinimumBasicScenario-2033476451 Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:13:28.543641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_32353b01d57e434eafdb5f253517ef93", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/32353b01d57e434eafdb5f253517ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/32353b01d57e434eafdb5f253517ef93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/32353b01d57e434eafdb5f253517ef93"}]}] Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestMinimumBasicScenario-2033476451 Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 32353b01d57e434eafdb5f253517ef93 Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2033476451 Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-TestMinimumBasicScenario-2033476451-project Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 365acac78e864078af1a3db4842bc149 Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestMinimumBasicScenario-2033476451-project Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:13:28.545177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 is not attached to volume 55179916-ff43-4924-b451-2981649a7293 Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'server_id': '49e8b055-46fd-4044-86cb-58e7594e0893', 'id': '55179916-ff43-4924-b451-2981649a7293'} Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 55179916-ff43-4924-b451-2981649a7293. Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:28.545898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 is not attached to volume 55179916-ff43-4924-b451-2981649a7293 Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 is not attached to volume 55179916-ff43-4924-b451-2981649a7293 Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:28.547319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Returning 404 to user: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 is not attached to volume 55179916-ff43-4924-b451-2981649a7293 {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:28.548387 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ffbbb152-dbd4-4e0f-9e48-59fa352864a7 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments/55179916-ff43-4924-b451-2981649a7293" status: 404 len: 154 microversion: 2.1 time: 0.090176 Jul 11 14:13:28.548387 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 374/743] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:13:28 2022] DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893/os-volume_attachments/55179916-ff43-4924-b451-2981649a7293 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:28.722276 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:28.722804 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:28.728643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.729090 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.729831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.730260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.754108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:13:28.756855 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:28.832475 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-de036c67-842a-4204-a2d3-097efce36881 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "DELETE /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 204 len: 0 microversion: 2.1 time: 0.113732 Jul 11 14:13:28.834371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 370/744] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:13:28 2022] DELETE /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:13:28.842328 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:28.843555 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:28.849571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.850019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.851064 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:28.851506 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:28.991909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:29.000343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e2880b87-74d2-4750-8c2a-50629e9e7279 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1508 microversion: 2.1 time: 0.162850 Jul 11 14:13:29.001161 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 375/745] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:28 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:29.686072 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:29.686685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:29.693184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:29.693632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:29.694427 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:29.694863 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:29.720691 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:13:29.795305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aa10951f-f805-4422-93bf-6831c9ffe72c tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 204 len: 0 microversion: 2.1 time: 0.113237 Jul 11 14:13:29.795885 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 371/746] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:13:29 2022] DELETE /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:13:29.804599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:29.805265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:29.812238 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:29.812685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:29.813496 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:29.813878 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:29.953034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:29.960536 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fb6fc3f8-b39e-461b-b6bd-592cf22670e0 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1552 microversion: 2.1 time: 0.160393 Jul 11 14:13:29.961095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 376/747] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:29 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:30.019035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:30.019735 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:30.025909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:30.026393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:30.027172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:30.027612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:30.161207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:30.168823 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d9a9949b-6f4e-4c0d-84fa-86f82bd5d1f0 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1508 microversion: 2.1 time: 0.154120 Jul 11 14:13:30.169452 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 372/748] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:30 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:30.978523 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:30.979061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:30.985169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:30.985628 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:30.986460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:30.986906 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:31.114565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:31.122045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-efb3e10d-f17b-47f1-9f50-1204ea88eecf tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1552 microversion: 2.1 time: 0.147549 Jul 11 14:13:31.122652 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 377/749] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:30 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:31.185927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:31.186562 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:31.193271 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:31.193717 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:31.194509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:31.194954 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:31.326645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:31.334040 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c2715ff2-7325-4656-ba21-4c3b5d35487e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1508 microversion: 2.1 time: 0.151924 Jul 11 14:13:31.334644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 373/750] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:31 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:32.139496 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:32.140106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:32.146069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.146549 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.147312 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.147743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.277446 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:32.285205 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d785bb40-c8b7-40ea-9f81-45f78912025a tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1552 microversion: 2.1 time: 0.150056 Jul 11 14:13:32.285780 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 378/751] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:32 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:32.355474 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:32.356360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:32.362793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.363238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.364092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.364528 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.499416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:32.506920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1c7ef1a5-cae3-469e-9389-05d2393f22a1 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1508 microversion: 2.1 time: 0.155442 Jul 11 14:13:32.507678 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 374/752] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:32 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:32.974817 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-cb756ae1-173a-4bee-bd93-b98e605970ae req-850629c7-e970-482d-bff9-8b92f702d570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246af345-cb1b-449d-abe1-4be428cb9ee3", "name": "network-vif-deleted", "tag": "9e9fda17-8838-4876-b6ae-3c59dd83071a"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:32.986240 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-cb756ae1-173a-4bee-bd93-b98e605970ae req-850629c7-e970-482d-bff9-8b92f702d570 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:32.986719 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-cb756ae1-173a-4bee-bd93-b98e605970ae req-850629c7-e970-482d-bff9-8b92f702d570 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:32.999138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-cb756ae1-173a-4bee-bd93-b98e605970ae req-850629c7-e970-482d-bff9-8b92f702d570 service nova] Creating event network-vif-deleted:9e9fda17-8838-4876-b6ae-3c59dd83071a for instance 246af345-cb1b-449d-abe1-4be428cb9ee3 on hv-cinder-84842 Jul 11 14:13:33.004839 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-cb756ae1-173a-4bee-bd93-b98e605970ae req-850629c7-e970-482d-bff9-8b92f702d570 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034487 Jul 11 14:13:33.006110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 379/753] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:33.302405 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:33.303020 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:33.309273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.309722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.310528 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.310963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.343751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.344204 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.344675 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lazy-loading 'fault' on Instance uuid 49e8b055-46fd-4044-86cb-58e7594e0893 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:13:33.386966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365acac78e864078af1a3db4842bc149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32353b01d57e434eafdb5f253517ef93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:33.395338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4ce3b01d-a45c-45b2-a02c-5e69e03e10c9 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 200 len: 1348 microversion: 2.1 time: 0.097023 Jul 11 14:13:33.396376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 375/754] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:33 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:33.524107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:33.524829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:33.532172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.532638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.533414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.533855 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.564752 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:33.565200 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:33.565651 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lazy-loading 'fault' on Instance uuid 246af345-cb1b-449d-abe1-4be428cb9ee3 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:13:33.606255 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:33.613598 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-18f0fba0-b6ce-4913-b771-2ffccd15d7dc tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 200 len: 1312 microversion: 2.1 time: 0.094153 Jul 11 14:13:33.614160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 380/755] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:33 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:34.412960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:34.413559 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] [instance: 49e8b055-46fd-4044-86cb-58e7594e0893] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:34.420563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.421000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.421750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.422178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.436091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] HTTP exception thrown: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 could not be found. Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Request method failure captured: Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 HTTP/1.1 Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC77P4ad7t27_UHhXYEW82BUDnge5tI_kGJayETDJUXj5ZkI0HHQqVecafqsV7gZ0u-oy3XDIJKyT9XaEUnjHzJzlL7S2khYXGj0NpfVaW7MFo1is_1b07coS55aU1NkPbyOF0btujol_GY9iPf0orPry9QqdFIziDL7LV9v-_klPMM Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 32353b01d57e434eafdb5f253517ef93 Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-TestMinimumBasicScenario-2033476451 Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:13:34.437727 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_32353b01d57e434eafdb5f253517ef93", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/32353b01d57e434eafdb5f253517ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/32353b01d57e434eafdb5f253517ef93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/32353b01d57e434eafdb5f253517ef93"}]}] Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-TestMinimumBasicScenario-2033476451 Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 32353b01d57e434eafdb5f253517ef93 Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2033476451 Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-TestMinimumBasicScenario-2033476451-project Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 365acac78e864078af1a3db4842bc149 Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-TestMinimumBasicScenario-2033476451-project Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 could not be found. Jul 11 14:13:34.439308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '49e8b055-46fd-4044-86cb-58e7594e0893'} Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 could not be found. Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:34.440163 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 could not be found. Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 could not be found. Jul 11 14:13:34.441325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.442362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Returning 404 to user: Instance 49e8b055-46fd-4044-86cb-58e7594e0893 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:34.442362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0f02d6a4-56a0-441c-b1c5-4494a42b4867 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893" status: 404 len: 111 microversion: 2.1 time: 0.030030 Jul 11 14:13:34.442362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 376/756] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:34 2022] GET /compute/v2.1/servers/49e8b055-46fd-4044-86cb-58e7594e0893 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:34.447738 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c66ae7ff-3030-4714-beea-4cca22737b08 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] Calling method '.version_select at 0x7ffad52e4280>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:34.464156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c66ae7ff-3030-4714-beea-4cca22737b08 tempest-TestMinimumBasicScenario-2033476451 tempest-TestMinimumBasicScenario-2033476451-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-495506554" status: 202 len: 0 microversion: 2.1 time: 0.020164 Jul 11 14:13:34.464713 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 381/757] 10.222.0.49 () {58 vars in 1268 bytes} [Mon Jul 11 14:13:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-495506554 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:13:34.631596 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:34.632248 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 246af345-cb1b-449d-abe1-4be428cb9ee3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:34.638817 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.639286 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.640044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.640477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.654819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] HTTP exception thrown: Instance 246af345-cb1b-449d-abe1-4be428cb9ee3 could not be found. Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Request method failure captured: Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 HTTP/1.1 Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Fsgmr1WTgQMKE5hZq2R64VsT0RCNwaHcoEocjE6DVCgURtIa0Bcl1Q2PVcJyb5htuG_AlChwJobYgN43aTlJwZLRkIhueXYPWK8UtUHtsY5wR57LfgWYKdNGbi-dwY2UFbve_MPkoFxtLHNT1hA3eEMvpjHNo1hoXRH3M7As_Cuc Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:13:34.656345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b181bc391914f6abcea09b894b88473", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b181bc391914f6abcea09b894b88473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}] Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: cf6cc756845148ee8fce9021425cb7cb Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 246af345-cb1b-449d-abe1-4be428cb9ee3 could not be found. Jul 11 14:13:34.657841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '246af345-cb1b-449d-abe1-4be428cb9ee3'} Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 246af345-cb1b-449d-abe1-4be428cb9ee3 could not be found. Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:34.659005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 246af345-cb1b-449d-abe1-4be428cb9ee3 could not be found. Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 246af345-cb1b-449d-abe1-4be428cb9ee3 could not be found. Jul 11 14:13:34.660386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:34.661674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Returning 404 to user: Instance 246af345-cb1b-449d-abe1-4be428cb9ee3 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:34.661674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9e739fac-f588-4fa1-aa16-3a4b4d9eb7a4 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3" status: 404 len: 111 microversion: 2.1 time: 0.030078 Jul 11 14:13:34.661674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 377/758] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:34 2022] GET /compute/v2.1/servers/246af345-cb1b-449d-abe1-4be428cb9ee3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:34.666044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:34.666573 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:34.673327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.673780 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.674576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.675017 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.701779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:13:34.783716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-380f98b2-d5f8-474f-a3b5-0b0cac6faaa9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 204 len: 0 microversion: 2.1 time: 0.121144 Jul 11 14:13:34.784568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 382/759] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:13:34 2022] DELETE /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:13:34.793708 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:34.794412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:34.801091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.801541 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.802330 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:34.802774 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:34.940435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:34.948195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4c76018c-ac31-4155-87a5-9b914a58fa9e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.158615 Jul 11 14:13:34.948841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 378/760] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:34 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:35.027967 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-a1cc7246-7dad-4fa9-bf52-e38af01f04cd req-c2507877-c6bb-4fb2-b571-67369ea72a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e8b055-46fd-4044-86cb-58e7594e0893", "name": "network-vif-deleted", "tag": "1a67ea54-5ffe-4602-930f-febfe4f1c871"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:35.036307 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a1cc7246-7dad-4fa9-bf52-e38af01f04cd req-c2507877-c6bb-4fb2-b571-67369ea72a4d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:35.036743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-a1cc7246-7dad-4fa9-bf52-e38af01f04cd req-c2507877-c6bb-4fb2-b571-67369ea72a4d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:35.049375 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-a1cc7246-7dad-4fa9-bf52-e38af01f04cd req-c2507877-c6bb-4fb2-b571-67369ea72a4d service nova] Creating event network-vif-deleted:1a67ea54-5ffe-4602-930f-febfe4f1c871 for instance 49e8b055-46fd-4044-86cb-58e7594e0893 on hv-cinder-84842 Jul 11 14:13:35.054759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-a1cc7246-7dad-4fa9-bf52-e38af01f04cd req-c2507877-c6bb-4fb2-b571-67369ea72a4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030791 Jul 11 14:13:35.055370 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 383/761] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:35.966740 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:35.968194 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:35.975378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:35.975829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:35.976605 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:35.977041 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:36.119444 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:36.127057 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6b1c4e0e-9157-4923-a4df-f4cbb02bf1d9 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.164754 Jul 11 14:13:36.127947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 379/762] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:35 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:37.145991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:37.146518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:37.153377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:37.154517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:37.155494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:37.156037 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:37.288446 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:37.296513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-988138b0-24f9-47ee-b2d4-4e566cc37540 tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.155386 Jul 11 14:13:37.306136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 384/763] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:37 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:38.313483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:38.314275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:38.320799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:38.321255 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:38.322028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:38.322553 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:38.453229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6cc756845148ee8fce9021425cb7cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b181bc391914f6abcea09b894b88473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:38.461084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aa180e51-7179-4d99-b6ee-564c2a2c3dad tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 200 len: 1522 microversion: 2.1 time: 0.151812 Jul 11 14:13:38.461755 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 380/764] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:38 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:38.567441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-dce1d267-82da-4eb8-9d57-c37ab88e7424 req-3cdf403a-c400-4b3b-97ac-d69a9684238c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d8c2737-675e-4124-86c5-2c06d1d65991", "name": "network-vif-deleted", "tag": "e0ad0377-4158-40bf-b3a5-efaddf7e18fe"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:38.577627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-dce1d267-82da-4eb8-9d57-c37ab88e7424 req-3cdf403a-c400-4b3b-97ac-d69a9684238c service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:38.578068 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-dce1d267-82da-4eb8-9d57-c37ab88e7424 req-3cdf403a-c400-4b3b-97ac-d69a9684238c service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:38.590482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-dce1d267-82da-4eb8-9d57-c37ab88e7424 req-3cdf403a-c400-4b3b-97ac-d69a9684238c service nova] Creating event network-vif-deleted:e0ad0377-4158-40bf-b3a5-efaddf7e18fe for instance 7d8c2737-675e-4124-86c5-2c06d1d65991 on hv-cinder-84842 Jul 11 14:13:38.596567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-dce1d267-82da-4eb8-9d57-c37ab88e7424 req-3cdf403a-c400-4b3b-97ac-d69a9684238c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033790 Jul 11 14:13:38.597712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 385/765] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:39.478983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:39.479510 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] [instance: 7d8c2737-675e-4124-86c5-2c06d1d65991] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:39.486472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:39.486925 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:39.487892 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:39.488502 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:39.502828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] HTTP exception thrown: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 could not be found. Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Request method failure captured: Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 HTTP/1.1 Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Fsgmr1WTgQMKE5hZq2R64VsT0RCNwaHcoEocjE6DVCgURtIa0Bcl1Q2PVcJyb5htuG_AlChwJobYgN43aTlJwZLRkIhueXYPWK8UtUHtsY5wR57LfgWYKdNGbi-dwY2UFbve_MPkoFxtLHNT1hA3eEMvpjHNo1hoXRH3M7As_Cuc Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:13:39.504382 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4b181bc391914f6abcea09b894b88473", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4b181bc391914f6abcea09b894b88473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4b181bc391914f6abcea09b894b88473"}]}] Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 4b181bc391914f6abcea09b894b88473 Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-602605400 Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: cf6cc756845148ee8fce9021425cb7cb Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-602605400-project Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 could not be found. Jul 11 14:13:39.505989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '7d8c2737-675e-4124-86c5-2c06d1d65991'} Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 could not be found. Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:39.510435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 could not be found. Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 could not be found. Jul 11 14:13:39.512431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:39.514483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] Returning 404 to user: Instance 7d8c2737-675e-4124-86c5-2c06d1d65991 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:39.514483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bc079f1a-8697-4d6d-9ab2-f4e3c4f1461e tempest-ServerRescueNegativeTestJSON-602605400 tempest-ServerRescueNegativeTestJSON-602605400-project] 10.222.0.49 "GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991" status: 404 len: 111 microversion: 2.1 time: 0.030922 Jul 11 14:13:39.514483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 381/766] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:39 2022] GET /compute/v2.1/servers/7d8c2737-675e-4124-86c5-2c06d1d65991 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:44.415005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-31451cc0-ef23-4ce4-83e3-7a2088e9be5d tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Action: 'create', calling method: .version_select at 0x7ffad514d9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2064769948", "metadata": {"Type": "work"}}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:44.700107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-31451cc0-ef23-4ce4-83e3-7a2088e9be5d tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.402467 Jul 11 14:13:44.700828 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 386/767] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 11 14:13:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 404 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 11 14:13:44.711712 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8bed64a2-b0a0-44fe-b6ff-c6d8a41f85fd tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Calling method '.version_select at 0x7ffad5018670>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:44.764950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8bed64a2-b0a0-44fe-b6ff-c6d8a41f85fd tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1" status: 200 len: 353 microversion: 2.1 time: 0.057248 Jul 11 14:13:44.765520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 382/768] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:44 2022] GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:45.778895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-04639e84-964f-48b0-9626-0e3a572fcdfa tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Calling method '.version_select at 0x7ffad51a1160>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:45.824570 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-04639e84-964f-48b0-9626-0e3a572fcdfa tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1" status: 200 len: 354 microversion: 2.1 time: 0.050039 Jul 11 14:13:45.825283 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 387/769] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:45 2022] GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:45.836462 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-003ac327-c7ca-4f4c-a0eb-64440a6158dc tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Calling method '.version_select at 0x7ffad5022e50>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:45.882859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-003ac327-c7ca-4f4c-a0eb-64440a6158dc tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1" status: 200 len: 354 microversion: 2.1 time: 0.050493 Jul 11 14:13:45.883426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 383/770] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:45 2022] GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:45.899194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1e93ced8-c573-4ce9-9614-7d2e7d142f33 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Calling method '.version_select at 0x7ffad52a8790>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:45.959598 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1e93ced8-c573-4ce9-9614-7d2e7d142f33 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1" status: 202 len: 0 microversion: 2.1 time: 0.064115 Jul 11 14:13:45.960196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 388/771] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:13:45 2022] DELETE /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:13:45.968947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a17fa77b-c877-49fa-9b4e-67fdd85cd773 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Calling method '.version_select at 0x7ffad5022f70>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:46.016429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a17fa77b-c877-49fa-9b4e-67fdd85cd773 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1" status: 200 len: 353 microversion: 2.1 time: 0.052031 Jul 11 14:13:46.016997 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 384/772] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:45 2022] GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:47.028717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93f1afd9-afdf-414d-820c-dda1515f02c7 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Calling method '.version_select at 0x7ffad52e4280>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:47.056625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-93f1afd9-afdf-414d-820c-dda1515f02c7 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] HTTP exception thrown: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93f1afd9-afdf-414d-820c-dda1515f02c7 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Request method failure captured: Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 HTTP/1.1 Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDAYwnd7SHhPtgM0-lf2eL3ydUFU8Sc8ramsWAjR1NlEwCn3EfsjfPVG0o7LiLhcLeCJdZdegtXPekCjle1rhgLnRP4vWNT0MTf1f8QoJ1Fu20JxvtDuu_fh8sqZQE9JuSucxeHt_qjuOh9u2KMyTyVNzl7TwyDtE4HKlLEGOn9GYSI Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: a704e02f36bc4ae7b4c084d2abff0e0f Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesGetTestJSON-1277362584 Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:13:47.058827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a704e02f36bc4ae7b4c084d2abff0e0f", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a704e02f36bc4ae7b4c084d2abff0e0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a704e02f36bc4ae7b4c084d2abff0e0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a704e02f36bc4ae7b4c084d2abff0e0f"}]}] Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesGetTestJSON-1277362584 Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: a704e02f36bc4ae7b4c084d2abff0e0f Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesGetTestJSON-1277362584 Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesGetTestJSON-1277362584-project Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 2e4813be17314acf84fe0312bc3628c6 Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesGetTestJSON-1277362584-project Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'c806309b-9081-4c38-9215-13600d6c52f1'} Jul 11 14:13:47.061013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. (HTTP 404) (Request-ID: req-021ff457-b600-4b99-9a8d-9b591868ce65) Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:47.062012 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:13:47.063480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:13:47.064876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93f1afd9-afdf-414d-820c-dda1515f02c7 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] Returning 404 to user: Volume c806309b-9081-4c38-9215-13600d6c52f1 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-93f1afd9-afdf-414d-820c-dda1515f02c7 tempest-VolumesGetTestJSON-1277362584 tempest-VolumesGetTestJSON-1277362584-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1" status: 404 len: 109 microversion: 2.1 time: 0.036016 Jul 11 14:13:47.066226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 389/773] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:13:47 2022] GET /compute/v2.1/os-volumes/c806309b-9081-4c38-9215-13600d6c52f1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:13:48.147440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:48.148364 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:48.155006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.155449 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.156208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.156642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.187044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-108f9041-c8a8-485b-a4eb-347665b34f46 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043877 Jul 11 14:13:48.187607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 385/774] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:13:48 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:13:48.248613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:48.249471 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:48.255687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.256139 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.256894 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.257327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.282862 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:13:48.358492 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-573f7cd6-749b-4ce6-a5dd-564027e0b9b7 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 204 len: 0 microversion: 2.1 time: 0.113201 Jul 11 14:13:48.359487 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 390/775] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:13:48 2022] DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:13:48.368354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:48.369030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:48.375146 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.375536 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.376294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:48.376731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:48.516081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:48.527767 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2f71e2aa-2dad-413f-b306-df4bcd00d53b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1670 microversion: 2.1 time: 0.164158 Jul 11 14:13:48.529355 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 386/776] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:48 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:49.546116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:49.546910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:49.553080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.553597 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.554358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:49.554978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:49.750945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:49.759436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bd61bc25-4da1-4d5f-9788-08fd3c509d97 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1670 microversion: 2.1 time: 0.217577 Jul 11 14:13:49.769289 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 391/777] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:49 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:50.749836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-d2fadb28-6579-45b5-af8e-dcc23ca83ac5 req-d94e3849-d570-4b6a-b2d3-1bed956abb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c538a6-c82b-4cc8-be39-aecd9c223140", "name": "network-vif-deleted", "tag": "57d96d85-ab17-428a-92d7-20cf06bf4d35"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:50.758751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-d2fadb28-6579-45b5-af8e-dcc23ca83ac5 req-d94e3849-d570-4b6a-b2d3-1bed956abb34 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.759207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-d2fadb28-6579-45b5-af8e-dcc23ca83ac5 req-d94e3849-d570-4b6a-b2d3-1bed956abb34 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.776110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-d2fadb28-6579-45b5-af8e-dcc23ca83ac5 req-d94e3849-d570-4b6a-b2d3-1bed956abb34 service nova] Creating event network-vif-deleted:57d96d85-ab17-428a-92d7-20cf06bf4d35 for instance e4c538a6-c82b-4cc8-be39-aecd9c223140 on hv-cinder-84842 Jul 11 14:13:50.784981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-d2fadb28-6579-45b5-af8e-dcc23ca83ac5 req-d94e3849-d570-4b6a-b2d3-1bed956abb34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039443 Jul 11 14:13:50.785623 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 387/778] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:50.788044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:50.790040 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:50.799703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.801242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.802567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:50.802697 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:50.835429 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:50.915384 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:50.929155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-93b455b1-9966-4f24-918a-f49941d5add0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 200 len: 1320 microversion: 2.1 time: 0.155936 Jul 11 14:13:50.935121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 392/779] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:50 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:13:51.955630 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:51.956888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:51.970010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.970647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.971805 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:51.972398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:51.986836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] HTTP exception thrown: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Request method failure captured: Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 HTTP/1.1 Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6JIjpkL2t-MSPfeIa2lQhawqMgbLl30Z8smVh-jLeIXMbWUfdxS1pKSvDi2ZjaKCMk0VqZzp9sTWuCnP2DD5usRBI6KukWxZGLjqk5t7aQ5OUEeKeBhq0VNh8k-T96PjfVN2q0nx-WavoKWV8unDKKlLQ8p8LNUIZ6rjARO3-gLqQ Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:13:51.988499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a772cbaa461c416da2cc35e364541ecf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}] Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 296853a88430438e96e0f8fb97b46d2e Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:13:51.990120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'e4c538a6-c82b-4cc8-be39-aecd9c223140'} Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:13:51.990978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:13:51.992211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:13:51.993306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Returning 404 to user: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:13:51.993306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f5521efa-2149-4a21-ac8a-6bd3ddf39375 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 404 len: 111 microversion: 2.1 time: 0.042336 Jul 11 14:13:51.993306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 388/780] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:51 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:51.998962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dfa4704d-bbef-401f-bd48-e279de93db00 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '.version_select at 0x7ffad5189550>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:52.004712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:52.020408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dfa4704d-bbef-401f-bd48-e279de93db00 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-70371059" status: 202 len: 0 microversion: 2.1 time: 0.025303 Jul 11 14:13:52.021180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 393/781] 10.222.0.49 () {58 vars in 1214 bytes} [Mon Jul 11 14:13:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-70371059 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:13:52.717011 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-171d80fe-d093-425b-930c-1df680630c2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: .version_select at 0x7ffad7a22ee0>, body: {"keypair": {"name": "tempest-keypair-1212780136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLWBxkwnZ8OVp1PVniVpV8yw83zMvY5kDC3HZXG4SeDgafwXo9c8cRlGDa3BHQDhIvS7woCpmbAUk6CpsLdct/mOk+voeChc28Sc8cVdr8Plvp34thTUjP6hengSvr7Lg=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:52.738899 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-171d80fe-d093-425b-930c-1df680630c2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for project a772cbaa461c416da2cc35e364541ecf. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:52.745771 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-171d80fe-d093-425b-930c-1df680630c2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for user 296853a88430438e96e0f8fb97b46d2e and project a772cbaa461c416da2cc35e364541ecf. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:52.767882 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:52.781719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-171d80fe-d093-425b-930c-1df680630c2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071585 Jul 11 14:13:52.786120 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 389/782] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:13:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:13:54.152333 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1042882536", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81252056-c78d-471a-b520-b6f6a1b0caa8"}], "security_groups": [{"name": "tempest-securitygroup--419913603"}], "key_name": "tempest-keypair-1212780136", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:54.259359 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] validate_networks() for [('81252056-c78d-471a-b520-b6f6a1b0caa8', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:13:54.882843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:13:54.883272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:13:54.883748 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:13:54.884161 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:13:54.884576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:13:54.894266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.894834 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.895678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:54.896352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:54.913306 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for project a772cbaa461c416da2cc35e364541ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:13:54.917307 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Getting quotas for user 296853a88430438e96e0f8fb97b46d2e and project a772cbaa461c416da2cc35e364541ecf. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:13:54.929073 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:13:54.931378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:13:54.979294 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-34a9b6a0-2da6-4d1c-8f58-3bcf696e2ade tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.831387 Jul 11 14:13:54.979952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 394/783] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:13:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:13:54.990408 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ffdf5504-8317-4ffe-a6b4-814da7ec4cea tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:54.991607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ffdf5504-8317-4ffe-a6b4-814da7ec4cea tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:55.048373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ffdf5504-8317-4ffe-a6b4-814da7ec4cea tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:55.056317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ffdf5504-8317-4ffe-a6b4-814da7ec4cea tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1238 microversion: 2.1 time: 0.070202 Jul 11 14:13:55.056890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 390/784] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:54 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:56.073225 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:56.081810 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:56.096401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.097222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.098663 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:56.099298 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:56.173283 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:56.182035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-511a4e40-e14a-473f-b4e6-7fbabe919b53 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1298 microversion: 2.1 time: 0.112789 Jul 11 14:13:56.182736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 395/785] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:56 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:57.199348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:57.200216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:57.206957 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.207413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.208238 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.208758 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.337765 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:57.345404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5f5194d8-fae0-4f37-96d7-19bf8812067b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.149951 Jul 11 14:13:57.345981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 391/786] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:57 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:57.929648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-5b5d009e-84bb-4053-a9e7-ff4690eb528a req-1048c0b5-e4f8-4f0e-9dff-df7c9408bb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1cc077-6cee-4ff4-9fa8-d44584daa613", "tag": "7fd0c458-b02e-405a-a868-f08fece32cb4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:13:57.941403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5b5d009e-84bb-4053-a9e7-ff4690eb528a req-1048c0b5-e4f8-4f0e-9dff-df7c9408bb08 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:57.941946 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5b5d009e-84bb-4053-a9e7-ff4690eb528a req-1048c0b5-e4f8-4f0e-9dff-df7c9408bb08 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:57.955778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-5b5d009e-84bb-4053-a9e7-ff4690eb528a req-1048c0b5-e4f8-4f0e-9dff-df7c9408bb08 service nova] Creating event network-changed:7fd0c458-b02e-405a-a868-f08fece32cb4 for instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 on hv-cinder-84842 Jul 11 14:13:57.960934 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-5b5d009e-84bb-4053-a9e7-ff4690eb528a req-1048c0b5-e4f8-4f0e-9dff-df7c9408bb08 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035698 Jul 11 14:13:57.961756 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 396/787] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:13:58.362859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:58.363374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:58.369739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.370201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.370965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:58.371396 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:58.375325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:58.501085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:58.508391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fea40ba6-7efc-42c6-926b-c935ff024b90 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.149542 Jul 11 14:13:58.509018 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 392/788] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:58 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:13:59.525488 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:13:59.526174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:13:59.533070 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.533510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.534259 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:13:59.534717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:13:59.667921 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:13:59.675882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b88a6a6e-040a-4b62-acc8-c3b0ac77e031 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.154330 Jul 11 14:13:59.676458 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 397/789] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:13:59 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:00.691821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:00.692428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:00.698901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.699339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.701200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:00.701200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:00.831728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:00.839751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1369c28b-33dc-48b1-9d29-471cf195dcbd tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.151503 Jul 11 14:14:00.840432 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 393/790] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:00 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:01.857247 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:01.858016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:01.864237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.864687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.865465 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:01.865903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:01.997924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:02.005328 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-109f49fc-14d4-402d-b040-5419dfb259c0 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.152867 Jul 11 14:14:02.005890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 398/791] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:01 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:03.021946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:03.022511 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:03.029521 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:03.029967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:03.030772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:03.031215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:03.160001 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:03.167296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-960b4d57-0da2-4bb2-9e93-829bf070d39d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.149289 Jul 11 14:14:03.167945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 394/792] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:03 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:04.185118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:04.185819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:04.193156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:04.193605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:04.194697 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:04.195185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:04.327248 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:04.341380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-02231329-0251-468a-b9f8-664ac5988022 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.154015 Jul 11 14:14:04.341380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 399/793] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:04 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:05.353032 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:05.353846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:05.356481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:05.361763 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.362207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.363037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:05.363465 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:05.525617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:05.533909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d85bad81-d404-4b5a-aad0-0985f0bb3ee8 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.184847 Jul 11 14:14:05.534510 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 395/794] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:05 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:06.551586 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:06.552187 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:06.554105 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:06.554824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:06.562109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.562649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.563420 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:06.563859 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:06.705517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:06.714195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3d34df69-69a9-414c-b678-548107bacb8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.166684 Jul 11 14:14:06.714836 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 400/795] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:06 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:07.731628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:07.732250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:07.739045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.739497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.740264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:07.740682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:07.884372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:07.891907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2eaa1e32-f82f-429a-bfa6-6fca2510c17c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.164112 Jul 11 14:14:07.892483 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 396/796] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:07 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:08.909146 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:08.909812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:08.915792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.916264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:08.917009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:08.917447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:09.047291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:09.055414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e9aea339-2024-4879-a63a-e89a917c6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.149736 Jul 11 14:14:09.055682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 401/797] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:08 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:09.217226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8009634c-cd37-42ec-ba2d-1e51444f0c6b req-c114c449-7097-4c63-802f-60909987119a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1cc077-6cee-4ff4-9fa8-d44584daa613", "name": "network-vif-plugged", "status": "completed", "tag": "7fd0c458-b02e-405a-a868-f08fece32cb4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:09.226028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8009634c-cd37-42ec-ba2d-1e51444f0c6b req-c114c449-7097-4c63-802f-60909987119a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:09.226578 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8009634c-cd37-42ec-ba2d-1e51444f0c6b req-c114c449-7097-4c63-802f-60909987119a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:09.242044 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8009634c-cd37-42ec-ba2d-1e51444f0c6b req-c114c449-7097-4c63-802f-60909987119a service nova] Creating event network-vif-plugged:7fd0c458-b02e-405a-a868-f08fece32cb4 for instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 on hv-cinder-84842 Jul 11 14:14:09.247967 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8009634c-cd37-42ec-ba2d-1e51444f0c6b req-c114c449-7097-4c63-802f-60909987119a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034598 Jul 11 14:14:09.248782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 397/798] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:10.072084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:10.072700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:10.079501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:10.079957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:10.080725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:10.081165 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:10.211919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:10.219955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5ba2a822-2621-406e-9af3-23e2191ae78a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1363 microversion: 2.1 time: 0.151834 Jul 11 14:14:10.220517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 402/799] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:10 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:11.237841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:11.238560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:11.245486 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.245923 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.246730 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.247160 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.524085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:14:11.531872 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6091d796-ff2e-45c5-9800-8beff862618c tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1548 microversion: 2.1 time: 0.298146 Jul 11 14:14:11.532440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 398/800] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:14:11 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1548 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:14:11.548855 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:11.549367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:11.555489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.555937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.556701 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:11.557123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:11.646191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c5d1c68d-dfa6-4f60-ac47-a5a62e63d909 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101087 Jul 11 14:14:11.646849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 403/801] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:14:11 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:12.568196 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-7502f632-291a-43ac-9449-12fdbecfa0ab req-0456be4d-5e6e-4b82-8cd1-ac64f9591461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd1cc077-6cee-4ff4-9fa8-d44584daa613", "tag": "7fd0c458-b02e-405a-a868-f08fece32cb4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:12.577257 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-7502f632-291a-43ac-9449-12fdbecfa0ab req-0456be4d-5e6e-4b82-8cd1-ac64f9591461 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:12.577693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-7502f632-291a-43ac-9449-12fdbecfa0ab req-0456be4d-5e6e-4b82-8cd1-ac64f9591461 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:12.588760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-7502f632-291a-43ac-9449-12fdbecfa0ab req-0456be4d-5e6e-4b82-8cd1-ac64f9591461 service nova] Creating event network-changed:7fd0c458-b02e-405a-a868-f08fece32cb4 for instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 on hv-cinder-84842 Jul 11 14:14:12.594084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-7502f632-291a-43ac-9449-12fdbecfa0ab req-0456be4d-5e6e-4b82-8cd1-ac64f9591461 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029290 Jul 11 14:14:12.594625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 399/802] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:42.460926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:42.461768 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=52 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:42.467334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:42.467830 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:42.476136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.476611 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.477355 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:42.477787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:42.504895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2c17f6d4-ab98-4d86-9da8-c5d4461c5d8e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/ips" status: 200 len: 150 microversion: 2.1 time: 0.045333 Jul 11 14:14:42.505825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 404/803] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:14:42 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:43.893731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=22 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:43.894482 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=38 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:43.899813 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e02c4251-2c1c-477b-9ad1-18167da004ba"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:43.901055 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:43.912440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:43.913099 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:43.914211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:43.914807 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:44.216886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bde2dc03-5d53-4b39-ac9e-ed876ea55c63 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324584 Jul 11 14:14:44.217664 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 400/804] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:14:43 2022] POST /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:14:55.966519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e02c4251-2c1c-477b-9ad1-18167da004ba"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:14:55.967569 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:55.969537 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:55.970170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:55.975810 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:55.976252 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:55.977013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:55.977445 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.068389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Invalid volume: volume e02c4251-2c1c-477b-9ad1-18167da004ba is already attached to instances: 21851a9e-91d2-4ced-87e9-abedb3c03835 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments HTTP/1.1 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 74 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:14:56.072145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {"volumeAttachment": {"volumeId": "e02c4251-2c1c-477b-9ad1-18167da004ba"}} Jul 11 14:14:56.073535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Invalid volume: volume e02c4251-2c1c-477b-9ad1-18167da004ba is already attached to instances: 21851a9e-91d2-4ced-87e9-abedb3c03835 Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'server_id': '21851a9e-91d2-4ced-87e9-abedb3c03835', 'body': {'volumeAttachment': {'volumeId': 'e02c4251-2c1c-477b-9ad1-18167da004ba'}}} Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e02c4251-2c1c-477b-9ad1-18167da004ba is already attached to instances: 21851a9e-91d2-4ced-87e9-abedb3c03835 Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:14:56.074984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e02c4251-2c1c-477b-9ad1-18167da004ba is already attached to instances: 21851a9e-91d2-4ced-87e9-abedb3c03835 Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:14:56.078436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e02c4251-2c1c-477b-9ad1-18167da004ba is already attached to instances: 21851a9e-91d2-4ced-87e9-abedb3c03835 Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 400 to user: Invalid volume: volume e02c4251-2c1c-477b-9ad1-18167da004ba is already attached to instances: 21851a9e-91d2-4ced-87e9-abedb3c03835 {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dc879a74-1f88-42f1-96f2-8a541d06a501 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112005 Jul 11 14:14:56.079646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 405/805] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:14:55 2022] POST /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:14:56.138195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:56.138988 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:56.143265 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:56.143932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:56.151363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.151816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.152602 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.153049 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.240374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lazy-loading 'services' on Instance uuid 21851a9e-91d2-4ced-87e9-abedb3c03835 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:14:56.320610 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-917ca414-3371-4e29-b57f-69117d658caf tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments/e02c4251-2c1c-477b-9ad1-18167da004ba" status: 202 len: 0 microversion: 2.1 time: 0.184166 Jul 11 14:14:56.321211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 401/806] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:14:56 2022] DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments/e02c4251-2c1c-477b-9ad1-18167da004ba => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:14:56.333985 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:56.335876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:56.349160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.349857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.350891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:56.351672 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:56.414358 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9bbd9e54-3a4c-470d-a705-e6ba9e137824 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085902 Jul 11 14:14:56.415853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 406/807] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:14:56 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:57.428900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:57.430282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:57.436819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:57.437267 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:57.438069 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:57.438520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:57.469913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6009e32f-b510-46f7-8b9f-a811cd78af3e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 Jul 11 14:14:57.470512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 402/808] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:14:57 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:58.482221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:58.483156 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:58.489109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:58.489550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:58.490318 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:58.490753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:58.520053 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-34e08ade-1fe7-48e4-b5ca-95eedc4f2968 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042387 Jul 11 14:14:58.520601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 407/809] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:14:58 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:14:59.531595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:14:59.532519 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:14:59.538971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:59.539425 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:59.540195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:14:59.540627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:14:59.572329 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a5a9e301-684e-4c39-ab12-fa02c1b77a22 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Jul 11 14:14:59.572873 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 403/810] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:14:59 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:00.583874 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:00.584808 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:00.590775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.591217 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.591961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:00.592389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:00.619887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-65ae73ee-ab09-4541-9e1b-8dc49a7540bb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039947 Jul 11 14:15:00.620978 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 408/811] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:15:00 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:01.632096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:01.633057 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:01.640326 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:01.640769 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:01.641546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:01.641981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:01.671038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-66aeccb5-baa3-4c5c-ba27-2a4a8f28de9c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042933 Jul 11 14:15:01.671790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 404/812] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:15:01 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:02.682433 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:02.683490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:02.690216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.690216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.691091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.691606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.725793 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-478e9b34-a58f-475d-a697-9f3c41243bbd tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046890 Jul 11 14:15:02.726253 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 409/813] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:15:02 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:15:02.782393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:02.782879 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:02.789270 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.789716 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.790513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.790946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.816319 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:15:02.894908 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ebb02d1a-f125-460b-8724-1fb619a6eb79 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 204 len: 0 microversion: 2.1 time: 0.115739 Jul 11 14:15:02.895223 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 405/814] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:15:02 2022] DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:15:02.906580 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:02.907242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:02.913661 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.914121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:02.915151 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:02.915581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:03.049874 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:03.058261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7394046e-4885-4a0d-a590-b32c0c917514 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.156965 Jul 11 14:15:03.058866 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 410/815] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:02 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:04.076094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:04.076922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:04.083531 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:04.083981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:04.084784 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:04.085224 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:04.218535 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:04.226059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f24266a1-89b1-4c45-91a4-3666b48b844b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.154786 Jul 11 14:15:04.226640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 406/816] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:04 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:05.243449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:05.244059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:05.250154 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:05.250632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:05.251389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:05.251825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:05.379819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:05.387794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-98784380-7ab1-4c11-8910-77d3d198cb17 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.148329 Jul 11 14:15:05.388369 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 411/817] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:05 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:06.405545 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:06.406158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:06.412760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.413214 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.413982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:06.414457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:06.544114 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:06.551790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ba48ad6e-59e8-4a36-b9dd-c97ffb9e1a6b tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.150707 Jul 11 14:15:06.552353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 407/818] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:06 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:07.570583 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:07.571939 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:07.578371 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.578822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.579647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.580086 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.715010 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:07.722899 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-86074ab5-f384-45c2-85a2-f8c28973d00f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.156333 Jul 11 14:15:07.723478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 412/819] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:07 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:07.974853 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:07.975426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:07.980244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-8edd0aca-a8b6-4e1b-b4b3-8dd9323b95f7 req-c26f5dc9-cfd2-4df5-a083-99ec91306e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:07.982206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.982749 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.983585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.984086 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:07.988522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-8edd0aca-a8b6-4e1b-b4b3-8dd9323b95f7 req-c26f5dc9-cfd2-4df5-a083-99ec91306e8a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:07.989038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-8edd0aca-a8b6-4e1b-b4b3-8dd9323b95f7 req-c26f5dc9-cfd2-4df5-a083-99ec91306e8a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.000460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-8edd0aca-a8b6-4e1b-b4b3-8dd9323b95f7 req-c26f5dc9-cfd2-4df5-a083-99ec91306e8a service nova] Creating event network-changed:4376997e-3ed7-4f63-b17e-1d9f27589ff4 for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e on hv-cinder-84842 Jul 11 14:15:08.005726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-8edd0aca-a8b6-4e1b-b4b3-8dd9323b95f7 req-c26f5dc9-cfd2-4df5-a083-99ec91306e8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029100 Jul 11 14:15:08.006373 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 413/820] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:08.014202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:15:08.093094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f325d3c4-1942-4caf-8aa1-21acf495e340 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 204 len: 0 microversion: 2.1 time: 0.122098 Jul 11 14:15:08.093677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 408/821] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:15:07 2022] DELETE /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:15:08.102240 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:08.102951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:08.109082 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.109541 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.110317 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.110877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.247032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:08.254678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cc6915f5-bbd5-43df-ae33-bb8983c26456 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.156308 Jul 11 14:15:08.262342 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 414/822] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:08 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:08.741357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:08.742063 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:08.753745 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.754228 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.755039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:08.755476 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:08.893401 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:08.901834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-691671b8-918b-42cf-a5aa-377a8bb67a6d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.164388 Jul 11 14:15:08.902475 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 409/823] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:08 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:09.272759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:09.273367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:09.280182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:09.280629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:09.281421 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:09.281858 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:09.408993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:09.416524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ed88c993-a7b6-4c38-a21a-c83349583651 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.147670 Jul 11 14:15:09.417095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 415/824] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:09 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:09.920724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:09.921457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:09.929685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:09.930244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:09.931585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:09.932112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.073922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:10.081566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c71f4bd3-0a1d-4b3d-b9c7-a8a4e90170e0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.165929 Jul 11 14:15:10.082132 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 410/825] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:09 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:10.434075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:10.434729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:10.440718 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:10.441177 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.441942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:10.442417 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:10.576378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:10.584170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1448ab34-502c-4488-bbc7-221055b08e84 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.153956 Jul 11 14:15:10.584744 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 416/826] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:10 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:11.098905 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:11.099525 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:11.106009 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:11.106504 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:11.107266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:11.107705 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:11.236777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:11.244404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a8cfacd1-cc65-4a80-a0c8-fbd781ce8edb tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1683 microversion: 2.1 time: 0.149371 Jul 11 14:15:11.245464 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 411/827] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:11 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:11.605449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:11.606979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:11.613272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:11.613819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:11.614707 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:11.615241 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:11.746916 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:11.759708 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6305422e-22bb-470f-a08e-dfb9f4d1a7ac tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.161864 Jul 11 14:15:11.773679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 417/828] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:11 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:12.262485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:12.263098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:12.269852 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:12.270315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:12.271222 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:12.271689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:12.333669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:12.341747 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ca32cca2-6338-450f-9133-bd170cf26d1d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1615 microversion: 2.1 time: 0.083570 Jul 11 14:15:12.342558 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 412/829] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:12 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:12.502534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-9ca201cc-4f0b-4588-802c-81908a6cf788 req-6b794028-626e-4f50-b018-1d644e50b1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21851a9e-91d2-4ced-87e9-abedb3c03835", "name": "network-vif-deleted", "tag": "827011e5-30e0-4612-b116-50bf98ff23c7"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:12.511511 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-9ca201cc-4f0b-4588-802c-81908a6cf788 req-6b794028-626e-4f50-b018-1d644e50b1b4 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:12.512044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-9ca201cc-4f0b-4588-802c-81908a6cf788 req-6b794028-626e-4f50-b018-1d644e50b1b4 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:12.524260 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-9ca201cc-4f0b-4588-802c-81908a6cf788 req-6b794028-626e-4f50-b018-1d644e50b1b4 service nova] Creating event network-vif-deleted:827011e5-30e0-4612-b116-50bf98ff23c7 for instance 21851a9e-91d2-4ced-87e9-abedb3c03835 on hv-cinder-84842 Jul 11 14:15:12.530060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-9ca201cc-4f0b-4588-802c-81908a6cf788 req-6b794028-626e-4f50-b018-1d644e50b1b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031301 Jul 11 14:15:12.530809 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 418/830] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:12.781315 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:12.781982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:12.788075 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:12.788528 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:12.789299 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:12.789741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:12.808435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:12.937649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:12.945458 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a201cdbb-6999-41da-b194-866d7aa21ee2 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.168116 Jul 11 14:15:12.946046 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 413/831] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:12 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:13.360061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:13.360755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:13.367176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:13.367622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:13.368392 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:13.368857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:13.433788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:13.441482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-783e7391-3695-4776-87dd-dc1df1205b1f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1615 microversion: 2.1 time: 0.085632 Jul 11 14:15:13.442075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 419/832] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:13 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:13.962902 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:13.963556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:13.970714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:13.971166 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:13.971929 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:13.972365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:14.100996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:14.108546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-273f556e-c562-441e-ae23-3d693bc8f04f tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.149553 Jul 11 14:15:14.109111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 414/833] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:13 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:14.458353 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:14.458963 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:14.465009 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:14.465453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:14.466207 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:14.466667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:14.529489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:14.537262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-713597af-78a6-433f-943b-8b8a0433a693 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1615 microversion: 2.1 time: 0.082763 Jul 11 14:15:14.537822 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 420/834] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:14 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:15.124783 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:15.125400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:15.131859 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:15.132405 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:15.133078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:15.133595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:15.267285 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:15.274896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ffad8ed6-e7d6-4247-a4d3-dc1413625f14 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1570 microversion: 2.1 time: 0.154001 Jul 11 14:15:15.275464 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 415/835] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:15 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:15.555525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:15.556147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:15.562824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:15.563266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:15.564024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:15.564459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:15.625973 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:15.633794 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-11336b85-f2d6-493b-be2d-1af942dbd153 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1615 microversion: 2.1 time: 0.082450 Jul 11 14:15:15.634382 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 421/836] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:15 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:16.293338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:16.293957 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:16.301125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:16.301290 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:16.302010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:16.302556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:16.451297 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:16.459733 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e3483da7-01dd-4e8c-a184-d0834b948128 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1451 microversion: 2.1 time: 0.170636 Jul 11 14:15:16.460307 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 416/837] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:16 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:16.654230 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:16.654873 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:16.663409 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:16.664407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:16.666477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:16.667777 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:16.701877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:16.702615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:16.703063 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lazy-loading 'fault' on Instance uuid 21851a9e-91d2-4ced-87e9-abedb3c03835 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:15:16.705894 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:16.758807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:16.770133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4c44410f-2447-49e2-b3d9-eea1fd855836 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 200 len: 1332 microversion: 2.1 time: 0.122237 Jul 11 14:15:16.772692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 422/838] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:16 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:16.823582 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-64102985-1198-423d-915a-84608c5045ce req-902c2497-35eb-4c08-9220-12e754dc0f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e", "name": "network-vif-deleted", "tag": "4376997e-3ed7-4f63-b17e-1d9f27589ff4"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:16.833471 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-64102985-1198-423d-915a-84608c5045ce req-902c2497-35eb-4c08-9220-12e754dc0f51 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:16.834023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-64102985-1198-423d-915a-84608c5045ce req-902c2497-35eb-4c08-9220-12e754dc0f51 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:16.846650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-64102985-1198-423d-915a-84608c5045ce req-902c2497-35eb-4c08-9220-12e754dc0f51 service nova] Creating event network-vif-deleted:4376997e-3ed7-4f63-b17e-1d9f27589ff4 for instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e on hv-cinder-84842 Jul 11 14:15:16.851922 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-64102985-1198-423d-915a-84608c5045ce req-902c2497-35eb-4c08-9220-12e754dc0f51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032378 Jul 11 14:15:16.852856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 417/839] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:17.476754 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:17.477366 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:17.483607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.484566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.484566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.485014 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.515020 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.515460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.515906 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lazy-loading 'fault' on Instance uuid 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:15:17.558581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12ac3751780495081b2ef41d13ba360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c01634e004b43239e6912ee0a9d1ffd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:17.566464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-95c9abce-b771-44bb-8343-4ff7461f6de9 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 200 len: 1225 microversion: 2.1 time: 0.093521 Jul 11 14:15:17.567147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 423/840] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:17 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:17.791472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:17.792172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:17.798421 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.798869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.799639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:17.800328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:17.814236 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 HTTP/1.1 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:15:17.815920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:15:17.817555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '21851a9e-91d2-4ced-87e9-abedb3c03835'} Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:15:17.822274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:15:17.824349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:15:17.825677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:15:17.825677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-87ee90d6-c0f6-4e09-8af4-0fe170277a43 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 404 len: 111 microversion: 2.1 time: 0.030628 Jul 11 14:15:17.825677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 418/841] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:17 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:15:17.827176 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-42a77608-678f-45ff-a87a-bfb0b26de27f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '.version_select at 0x7ffad514d160>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:17.845393 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-42a77608-678f-45ff-a87a-bfb0b26de27f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841767448" status: 202 len: 0 microversion: 2.1 time: 0.022916 Jul 11 14:15:17.845974 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 424/842] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 11 14:15:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841767448 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:15:18.467312 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fa1ad2a1-9758-478b-9373-e464171408ba tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: .version_select at 0x7ffad5000940>, body: {"keypair": {"name": "tempest-keypair-2080024710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGAM0PFLXpTAvOe1LfLRR9GkwXCWeoJb6DD+Kna2l0x9sGFZJuYlSxX9hK0QjiFbynwA83tkHUu5mGdk9eNS+Hekc6M8UxXkGY5Gugs+wyF2AbtNvvjt13cWuqRPIQogw=="}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:18.481563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-fa1ad2a1-9758-478b-9373-e464171408ba tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:18.485373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-fa1ad2a1-9758-478b-9373-e464171408ba tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'key_pairs'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:18.508088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fa1ad2a1-9758-478b-9373-e464171408ba tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044585 Jul 11 14:15:18.508700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 419/843] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:15:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:18.585478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:18.586414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] [instance: 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:18.593091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:18.593642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:18.594527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:18.595043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:18.608951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] HTTP exception thrown: Instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e could not be found. Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Request method failure captured: Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e HTTP/1.1 Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC7ZY0vX5MExyYlB60cJAycv7dM0oe746aLdTVz3hksMbmfl7sVfHH6CJNck_ICQ1ulqiQ4a0k6mYIsYBx5OlegAFZ5vcdRQqQBJAoL1pcYL3dAxtk_8uqz2KnYiMIr1_P8Dw6xIIeNut6Y0qYXPoTFgOcW38sDZ0xDk3fjHDU_sj-4 Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 2c01634e004b43239e6912ee0a9d1ffd Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestShelveInstance-852706715 Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:15:18.610613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2c01634e004b43239e6912ee0a9d1ffd", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2c01634e004b43239e6912ee0a9d1ffd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2c01634e004b43239e6912ee0a9d1ffd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2c01634e004b43239e6912ee0a9d1ffd"}]}] Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestShelveInstance-852706715 Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 2c01634e004b43239e6912ee0a9d1ffd Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestShelveInstance-852706715 Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-TestShelveInstance-852706715-project Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: e12ac3751780495081b2ef41d13ba360 Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestShelveInstance-852706715-project Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e could not be found. Jul 11 14:15:18.612110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e'} Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e could not be found. Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:15:18.613498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e could not be found. Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e could not be found. Jul 11 14:15:18.615172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:15:18.616788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Returning 404 to user: Instance 4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:15:18.616788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-edbcb033-2402-4ae3-ac29-840ee31d1462 tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e" status: 404 len: 111 microversion: 2.1 time: 0.031492 Jul 11 14:15:18.616788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 425/844] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:18 2022] GET /compute/v2.1/servers/4d5b4e77-78e1-4d5e-b287-a24bdc0cb97e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:15:18.826071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-426b9eba-bce5-4bf5-997f-b88306109b2b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] Calling method '.version_select at 0x7ffad50b7e50>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:18.846211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-426b9eba-bce5-4bf5-997f-b88306109b2b tempest-TestShelveInstance-852706715 tempest-TestShelveInstance-852706715-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1303563081" status: 202 len: 0 microversion: 2.1 time: 0.025174 Jul 11 14:15:18.847659 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 420/845] 10.222.0.49 () {58 vars in 1253 bytes} [Mon Jul 11 14:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1303563081 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:15:20.826870 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-48803743", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f652801d-32e3-4c8b-a676-9f89f4a15dcd"}], "security_groups": [{"name": "tempest-securitygroup--1092085351"}], "key_name": "tempest-keypair-2080024710", "user_data": "}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:20.947600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] validate_networks() for [('f652801d-32e3-4c8b-a676-9f89f4a15dcd', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:15:21.323593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:15:21.324016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:15:21.324691 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:15:21.325098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:15:21.325508 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:15:21.334423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:21.334873 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:21.335666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:21.336331 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:21.354337 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:21.359239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Getting quotas for user 04e86369906d4633b02a5ca1bcc24b35 and project da749564df7941929c6cb9159479d637. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:21.373256 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:15:21.375579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:15:21.432141 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-173f7af2-313c-40ca-a7d4-c2cca914d70a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609931 Jul 11 14:15:21.433191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 426/846] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:15:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:15:21.443530 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-de5d7497-4089-4e28-9b15-980948826e91 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:21.444832 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-de5d7497-4089-4e28-9b15-980948826e91 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:21.519308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-de5d7497-4089-4e28-9b15-980948826e91 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:21.527937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-de5d7497-4089-4e28-9b15-980948826e91 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1240 microversion: 2.1 time: 0.088578 Jul 11 14:15:21.528953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 421/847] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:21 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:22.546767 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:22.547787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:22.559432 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:22.559882 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:22.564701 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:22.565499 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:22.659581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:22.672418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e9f84ac2-fb58-453c-80e6-e4aff1438c69 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1300 microversion: 2.1 time: 0.130759 Jul 11 14:15:22.678222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 427/848] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:22 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:23.694141 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:23.695126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:23.702595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:23.703304 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:23.704085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:23.705067 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:23.798357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:23.810653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-63b6b3a1-c4af-4a48-a795-4c292cb3298c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1298 microversion: 2.1 time: 0.119960 Jul 11 14:15:23.816438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 422/849] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:23 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:24.827890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:24.828599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:24.844202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:24.858248 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:24.859501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:24.860111 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:24.897806 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-870e78e7-46de-4ee4-9442-37cd206a2699 req-89e99054-6c5d-4860-9d59-2c0df9c3585b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79701d5-dc0a-4c8d-a9b4-a47b950b77a7", "tag": "baff141b-1b0c-403d-ab6d-3fa5acfe54af"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:24.909620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-870e78e7-46de-4ee4-9442-37cd206a2699 req-89e99054-6c5d-4860-9d59-2c0df9c3585b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:24.914249 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-870e78e7-46de-4ee4-9442-37cd206a2699 req-89e99054-6c5d-4860-9d59-2c0df9c3585b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:24.938055 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-870e78e7-46de-4ee4-9442-37cd206a2699 req-89e99054-6c5d-4860-9d59-2c0df9c3585b service nova] Creating event network-changed:baff141b-1b0c-403d-ab6d-3fa5acfe54af for instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 on hv-cinder-84842 Jul 11 14:15:24.954416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-870e78e7-46de-4ee4-9442-37cd206a2699 req-89e99054-6c5d-4860-9d59-2c0df9c3585b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060226 Jul 11 14:15:24.955631 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 423/850] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:15:25.374193 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:15:25.374566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:15:25.476999 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:25.489818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b67e7c71-4b57-4796-bc1d-e25b0f1183d4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.665787 Jul 11 14:15:25.501010 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 428/851] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:24 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:26.508181 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:26.508871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:26.511343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:26.517729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:26.518175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:26.518983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:26.519411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:26.744115 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:26.752413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-62f70d6d-92fb-40fc-bfae-810152808a8f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.248883 Jul 11 14:15:26.752961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 424/852] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:26 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:27.768870 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:27.769493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:27.772462 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:27.777434 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:27.777885 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:27.778686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:27.779126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:27.916656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:27.924222 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-706cddb9-baa3-4395-892e-f021c81bdd0e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.159250 Jul 11 14:15:27.924905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 429/853] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:27 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:28.941802 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:28.942484 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:28.949399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:28.949924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:28.950920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:28.951513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:29.137569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:29.146635 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fbe80999-0db1-4b9a-9f81-a57ba0eea924 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.209390 Jul 11 14:15:29.147287 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 425/854] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:28 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:30.165344 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:30.166976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:30.173481 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:30.173970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:30.175454 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:30.175965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:30.336356 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:30.346030 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-75e340aa-febb-4005-a15a-e5f93211c73f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.184526 Jul 11 14:15:30.346745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 430/855] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:30 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:31.363809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:31.365050 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:31.373161 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:31.373654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:31.374542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:31.375054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:31.534640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:31.629203 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:31.637777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5ce6ae40-cceb-4bc1-a7a2-671737fb7b4e tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.277797 Jul 11 14:15:31.638492 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 426/856] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:31 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:32.654898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:32.656351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:32.660543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:32.661636 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:32.690191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:32.692050 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:32.695552 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:32.696505 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:32.973952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:32.984498 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f73459ba-35f1-4398-a0e1-3aed537f5cb3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.333309 Jul 11 14:15:32.986356 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 431/857] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:32 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:34.001839 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:34.003175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:34.010004 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:34.010391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:34.011350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:34.011939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:34.187910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:34.196671 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2b9f8bd5-dbe5-4e38-a87f-94b52e1eeebc tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.198631 Jul 11 14:15:34.198296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 427/858] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:33 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:15:34.411647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-4871b55a-50e0-4f8f-8fef-cb53dd7f135c req-0bbb4267-ede8-4ac6-bf99-6daeb2d7295d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79701d5-dc0a-4c8d-a9b4-a47b950b77a7", "name": "network-vif-plugged", "status": "completed", "tag": "baff141b-1b0c-403d-ab6d-3fa5acfe54af"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:34.432771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-4871b55a-50e0-4f8f-8fef-cb53dd7f135c req-0bbb4267-ede8-4ac6-bf99-6daeb2d7295d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:34.433548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-4871b55a-50e0-4f8f-8fef-cb53dd7f135c req-0bbb4267-ede8-4ac6-bf99-6daeb2d7295d service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:34.455450 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-4871b55a-50e0-4f8f-8fef-cb53dd7f135c req-0bbb4267-ede8-4ac6-bf99-6daeb2d7295d service nova] Creating event network-vif-plugged:baff141b-1b0c-403d-ab6d-3fa5acfe54af for instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 on hv-cinder-84842 Jul 11 14:15:34.468116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-4871b55a-50e0-4f8f-8fef-cb53dd7f135c req-0bbb4267-ede8-4ac6-bf99-6daeb2d7295d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060333 Jul 11 14:15:34.470022 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 432/859] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:35.216692 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:35.218159 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:35.225556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:35.226179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:35.227278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:35.227828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:35.393963 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:35.403043 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e943ad6f-bf4a-4696-9bd4-38e7e1c2261d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1366 microversion: 2.1 time: 0.192565 Jul 11 14:15:35.413594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 428/860] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:35 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:36.423955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:36.425572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:36.449422 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.451566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.452807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.453453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.623747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:36.635268 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d247bd68-c629-4c26-b623-11d0ef2b9f25 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1555 microversion: 2.1 time: 0.217624 Jul 11 14:15:36.638934 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 433/861] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:15:36 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:15:36.658393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:36.659932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:36.670680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.675686 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.676527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:36.681938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:36.781111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-17c7b900-31c7-48be-a429-fc90da68dcf0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129563 Jul 11 14:15:36.782166 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 429/862] 10.222.0.49 () {58 vars in 1274 bytes} [Mon Jul 11 14:15:36 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:37.312977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:37.313460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:37.326479 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.326942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:37.327737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:37.328179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:37.399015 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cfdebe05-34d7-48a2-8a26-1ad67985ef06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/ips" status: 200 len: 152 microversion: 2.20 time: 0.089885 Jul 11 14:15:37.399617 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 434/863] 10.222.0.49 () {60 vars in 1288 bytes} [Mon Jul 11 14:15:37 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/ips => generated 152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:15:38.702066 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-0062cb55-a929-4aa2-a56d-9b279153d190 req-a216c372-de1f-436b-bf26-2b9afc8c2d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a79701d5-dc0a-4c8d-a9b4-a47b950b77a7", "tag": "baff141b-1b0c-403d-ab6d-3fa5acfe54af"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:38.716654 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-0062cb55-a929-4aa2-a56d-9b279153d190 req-a216c372-de1f-436b-bf26-2b9afc8c2d71 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:38.717109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-0062cb55-a929-4aa2-a56d-9b279153d190 req-a216c372-de1f-436b-bf26-2b9afc8c2d71 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:38.747974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-0062cb55-a929-4aa2-a56d-9b279153d190 req-a216c372-de1f-436b-bf26-2b9afc8c2d71 service nova] Creating event network-changed:baff141b-1b0c-403d-ab6d-3fa5acfe54af for instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 on hv-cinder-84842 Jul 11 14:15:38.758230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-0062cb55-a929-4aa2-a56d-9b279153d190 req-a216c372-de1f-436b-bf26-2b9afc8c2d71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061321 Jul 11 14:15:38.760202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 430/864] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:15:39.612910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:39.613468 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:39.620602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:39.621450 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:39.622540 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:39.623184 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:39.676133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lazy-loading 'flavor' on Instance uuid 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:15:40.146765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b4dd9472-5d10-41f5-a64d-f0d521ebf321 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/action" status: 202 len: 0 microversion: 2.20 time: 0.536667 Jul 11 14:15:40.154474 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 435/865] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 11 14:15:39 2022] POST /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:15:40.166595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:40.172479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:40.189179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:40.191029 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:40.192275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:40.192956 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:40.489314 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:40.502427 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:40.504088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:40.505509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cf05a15e-3050-47f5-91cd-f35aef75fff6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.350347 Jul 11 14:15:40.510507 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 431/866] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:40 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:41.529706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:41.530367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b30622e4-e798-43ae-86bd-ad7f44e8421d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Action: 'create', calling method: .version_select at 0x7ffad514d9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-109109376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWdBFAmm5OMOT2q29EBUsD/RwIumWjKXDPg4AwdYGbZpqDfe0flZl+rogO1OccrVqREQet6frrDFFPFFAguG83DZ6nsUrT+uQWaNl9a6NsWfW+3BKREX2HfmEWq5XU4nQ=="}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:15:41.531414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:41.538372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.539274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.540216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:41.540860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:41.545577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-b30622e4-e798-43ae-86bd-ad7f44e8421d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:15:41.552824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-b30622e4-e798-43ae-86bd-ad7f44e8421d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for user 3c85d19cf42f4688bbc89a439d96ca69 and project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'key_pairs'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:15:41.588727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b30622e4-e798-43ae-86bd-ad7f44e8421d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.493703 Jul 11 14:15:41.595410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 436/867] 10.222.0.49 () {60 vars in 1158 bytes} [Mon Jul 11 14:15:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:15:41.752393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:41.768710 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:41.770255 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:41.784435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6f2c4895-4c8e-4db4-af77-1c3e9f18dd3c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.256288 Jul 11 14:15:41.784435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 432/868] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:41 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:42.800490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:42.801371 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:42.808397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.809105 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.810256 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:42.811391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:42.972117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.991820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.994784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:42.996732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-51313dd5-de59-4e61-9993-63de2a4cb890 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.200940 Jul 11 14:15:42.997824 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 437/869] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:42 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:44.016590 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:44.017200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:44.023719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:44.024291 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.025179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:44.026196 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:44.031308 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=81 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:44.173241 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:44.181842 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:44.183435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:44.184603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3792a285-417b-44c2-bd1c-2b7e9a060765 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.171944 Jul 11 14:15:44.185175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 433/870] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:44 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:45.202977 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:45.204265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:45.210571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.211233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.212266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:45.213055 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:45.368476 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:45.377760 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:45.379331 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:45.380537 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-480163f0-1960-4b0d-830b-08b67c7859fb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.181486 Jul 11 14:15:45.381121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 438/871] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:45 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:46.401006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:46.402284 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:46.412560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:46.413008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:46.413823 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:46.414532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:46.551557 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:46.561333 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:46.563587 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:46.565000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3cd2c7f5-4c1e-431c-8355-6aad11dd197b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.167802 Jul 11 14:15:46.565996 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 434/872] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:46 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:47.583789 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:47.584398 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:47.590275 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.590759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.591492 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:47.591921 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:47.594530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:47.723542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:47.731665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:47.733201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:47.734444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7ea2a357-f40b-44c9-a32f-4fcf5759857a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.154801 Jul 11 14:15:47.735007 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 439/873] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:47 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:48.752897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:48.753497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:48.759890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:48.760395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:48.761144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:48.761586 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:48.901244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:48.910772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:48.913029 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:48.914499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-324b6398-ca28-44f3-825d-488a052bc325 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.165545 Jul 11 14:15:48.915502 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 435/874] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:48 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:15:49.933524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:49.934141 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:49.940323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:49.940778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:49.941600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:49.942041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:50.077651 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:50.085646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:50.087877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:50.088972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e9240fd1-e420-4324-bda5-7fd96c608cf1 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.159964 Jul 11 14:15:50.089589 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 440/875] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:49 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:51.108806 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:51.110227 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:51.118178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:51.119411 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:51.120513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:51.120984 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:51.265783 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:51.274285 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:51.276041 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:51.277208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fe1bf313-9875-4dc3-aa9c-6dd02ccd120a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.173372 Jul 11 14:15:51.277767 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 436/876] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:51 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:52.297062 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:52.298332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:52.300696 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=4 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:52.307509 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.307966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.308752 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:52.309196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:52.451077 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:52.459395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:52.460933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:52.462135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-23aa9853-af66-4b29-8a8b-70fbf42a0bd8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.169848 Jul 11 14:15:52.462759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 441/877] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:52 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:53.481497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:53.482139 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:53.490006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:53.490006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:53.490225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:53.490532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:53.635096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:53.644795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:53.646408 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:53.647677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c634cefd-4846-4313-b609-47230d6167c8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.171107 Jul 11 14:15:53.658872 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 437/878] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:53 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:54.666831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:54.667650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:54.673633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.674084 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.675139 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:54.675575 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:54.818917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:54.827474 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:54.828997 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:54.830206 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-48c63064-5909-40ba-8193-327a1a123394 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.167943 Jul 11 14:15:54.830820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 442/879] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:54 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:55.850089 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:55.851007 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:55.861337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:55.862247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:55.863752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:55.864435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:56.009971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:56.018426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:56.019978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:56.021215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fa9426b0-28b0-4bf5-b8f8-4ab8c2b9a0be tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.176159 Jul 11 14:15:56.021809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 438/880] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:55 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:57.039665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:57.040891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:57.047023 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.047480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.048257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:57.048703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:57.181168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:57.189124 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:57.190646 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:57.191783 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bb1920fa-7396-4c77-8acd-31ebcbf72062 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.156195 Jul 11 14:15:57.192338 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 443/881] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:57 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:15:58.211065 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:58.211728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:58.214716 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=30 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:58.220211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:58.220665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:58.221440 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:58.221877 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:58.356179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:58.364269 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:58.365790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:58.367002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d0307642-feeb-405c-80cd-4626a8e67ecb tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.159980 Jul 11 14:15:58.367571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 439/882] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:58 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:15:59.386350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:15:59.387003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:15:59.388966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:59.394273 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.394834 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.395534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:15:59.395974 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:15:59.527430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:59.535331 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:59.536842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:15:59.537999 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-906c71cc-2660-429e-a1eb-6400672c392d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.156075 Jul 11 14:15:59.538601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 444/883] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:15:59 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:00.277971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-5db872c7-3c88-4f66-bc1f-d7298e6b3f1c req-a765b190-c443-4d4f-92f6-411b3581d27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "name": "network-vif-plugged", "status": "completed", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:00.286054 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-5db872c7-3c88-4f66-bc1f-d7298e6b3f1c req-a765b190-c443-4d4f-92f6-411b3581d27e service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:00.286524 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-5db872c7-3c88-4f66-bc1f-d7298e6b3f1c req-a765b190-c443-4d4f-92f6-411b3581d27e service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:00.299162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-5db872c7-3c88-4f66-bc1f-d7298e6b3f1c req-a765b190-c443-4d4f-92f6-411b3581d27e service nova] Creating event network-vif-plugged:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:16:00.304790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-5db872c7-3c88-4f66-bc1f-d7298e6b3f1c req-a765b190-c443-4d4f-92f6-411b3581d27e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031084 Jul 11 14:16:00.305783 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 440/884] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:00.559972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:00.560577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:00.566629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:00.567108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:00.567875 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:00.568313 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:00.698237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:00.706869 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:00.708277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:00.709587 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d3dac623-1c68-4679-afca-116792a2e79c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.154227 Jul 11 14:16:00.710261 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 445/885] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:00 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:01.730799 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:01.731503 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:01.738503 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.738950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.739719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:01.740153 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:01.893380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.909800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.911880 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:01.913355 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cdcfbc84-679c-4e3a-8c3d-1f49a2ee3e8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.187735 Jul 11 14:16:01.914109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 441/886] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:01 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:02.933514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:02.934125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:02.940339 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.940789 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:02.941606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:02.942046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:03.078163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:03.087724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:03.089431 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:03.090842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2f4047a1-a583-4cf2-bf0b-5ef9c43f5cc9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.161719 Jul 11 14:16:03.092118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 446/887] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:02 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:04.109692 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:04.111088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:04.117878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:04.119262 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:04.120034 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:04.120496 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:04.255457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.264256 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.265772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:04.266966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-99a5667a-2cd5-4ea2-a750-6993b386391d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.161222 Jul 11 14:16:04.267517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 442/888] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:04 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:05.285026 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:05.285640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:05.294074 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.294564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.295353 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:05.295795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:05.432343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:05.440149 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:05.441632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:05.442843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1a8d9407-23e5-411b-97c8-429ba9db12af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.161769 Jul 11 14:16:05.443393 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 447/889] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:05 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:06.460703 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:06.461318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:06.468449 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.468903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.469698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:06.470138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:06.595561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.603754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.605244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:06.606414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a94601bc-267f-4c6a-b644-16997b644bb2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1745 microversion: 2.20 time: 0.149936 Jul 11 14:16:06.607173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 443/890] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:06 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:07.624134 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:07.625344 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:07.631692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.632151 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.632973 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:07.634180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:07.775662 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.784178 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.785670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:07.786852 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f2ab1792-134c-47ef-a46f-1f647b0b33e2 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.166934 Jul 11 14:16:07.787406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 448/891] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:07 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:08.805294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:08.805924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:08.812923 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.813374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:08.814143 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:08.814608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:09.212276 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.220932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.222508 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:09.223678 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b8be924e-35e3-437d-bbfd-2c1977c46b8a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.422325 Jul 11 14:16:09.224243 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 444/892] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:08 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:09.616194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1574149926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-109109376", "security_groups": [{"name": "tempest-secgroup-smoke-331792550"}], "block_device_mapping_v2": [{"uuid": "77814d98-aa8b-488e-aee7-e8248715f609", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "399e9466-9fd1-4e23-afd7-ae28f17cf4de"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:09.732341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] validate_networks() for [('399e9466-9fd1-4e23-afd7-ae28f17cf4de', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:16:10.133069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:16:10.133493 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:16:10.134045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:16:10.134476 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:16:10.134886 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:16:10.143597 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.144035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.144818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.145245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.163665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:16:10.168325 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for user 3c85d19cf42f4688bbc89a439d96ca69 and project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:16:10.228618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:16:10.230837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77814d98-aa8b-488e-aee7-e8248715f609',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:16:10.240943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:10.241760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:10.249305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.249758 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.250568 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:10.251006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:10.415886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:10.426878 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cea6c431-fae0-4dcb-a012-dbc0fd352038 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.812038 Jul 11 14:16:10.433666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 449/893] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:16:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:16:10.436994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:10.438600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:10.439059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-886ba905-09b5-4c87-b75a-8841da8c67e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:10.439670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-886ba905-09b5-4c87-b75a-8841da8c67e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:10.439797 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-362f9a00-a8b2-4ebd-8ea6-8810d5f23935 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.202735 Jul 11 14:16:10.440306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 445/894] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:10 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:10.494093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-886ba905-09b5-4c87-b75a-8841da8c67e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:10.501935 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-886ba905-09b5-4c87-b75a-8841da8c67e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1094 microversion: 2.1 time: 0.066846 Jul 11 14:16:10.502518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 450/895] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:10 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:11.457224 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:11.457862 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:11.469453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.472243 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.473282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:11.473946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:11.519726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9cc5b888-5668-4424-aeaa-d60085ef34ae tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:11.524972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9cc5b888-5668-4424-aeaa-d60085ef34ae tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:11.611057 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9cc5b888-5668-4424-aeaa-d60085ef34ae tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.618942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9cc5b888-5668-4424-aeaa-d60085ef34ae tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1094 microversion: 2.1 time: 0.102218 Jul 11 14:16:11.619900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 451/896] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:11 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:11.672677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.681652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.683187 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:11.684356 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c36474a2-2705-4f0d-91d8-84918b3f0414 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.231310 Jul 11 14:16:11.684916 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 446/897] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:11 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:12.637592 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9270bfe0-c29c-4fc1-bf24-5eff053975a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:12.638887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9270bfe0-c29c-4fc1-bf24-5eff053975a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:12.703789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:12.704405 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:12.709083 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9270bfe0-c29c-4fc1-bf24-5eff053975a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:12.715814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.716365 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9270bfe0-c29c-4fc1-bf24-5eff053975a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1094 microversion: 2.1 time: 0.083281 Jul 11 14:16:12.717909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.718047 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 452/898] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:12 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:12.719744 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:12.722947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:12.870213 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:12.881555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:12.885187 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:12.886829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9f77a1ea-c4be-4bec-9b84-20c96cdb2fa7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.187430 Jul 11 14:16:12.896598 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 447/899] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:12 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:13.734738 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a472ae2e-611a-4cc1-b9c9-a32e7ce0b458 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:13.735348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a472ae2e-611a-4cc1-b9c9-a32e7ce0b458 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:13.793264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a472ae2e-611a-4cc1-b9c9-a32e7ce0b458 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:13.802845 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a472ae2e-611a-4cc1-b9c9-a32e7ce0b458 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1094 microversion: 2.1 time: 0.071815 Jul 11 14:16:13.803541 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 453/900] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:13 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:13.916147 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:13.917527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:13.934362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:13.935135 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:13.936957 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:13.937409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.099776 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:14.103002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=90 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:14.110575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:14.112101 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:14.113274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-643db63d-dfd6-41cf-8b31-c03ad239d80b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.211657 Jul 11 14:16:14.118666 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 448/901] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:13 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:14.309635 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:14.310031 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:14.318460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.318976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.319795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.320270 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.350341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3e038de8-4668-422b-9a8e-ed90edfeb927 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/ips" status: 200 len: 143 microversion: 2.1 time: 0.043439 Jul 11 14:16:14.350341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 454/902] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:16:14 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/ips => generated 143 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:14.819860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:14.820491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:14.827366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.827869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.828584 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:14.828991 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:14.893849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:14.903107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-675711f1-3126-421a-b9c2-fd327de9e59b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1144 microversion: 2.1 time: 0.087253 Jul 11 14:16:14.904028 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 449/903] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:14 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:15.135060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:15.135666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:15.163998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.164451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.165750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.166189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.351831 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:15.362117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:15.364109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:15.365304 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b33c0db7-41d6-4545-9491-76f9853f88a6 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.236455 Jul 11 14:16:15.365854 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 455/904] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:15 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:15.716535 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d81caf7b-6a54-4745-b2ff-4f5846989f93"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:15.717849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:15.730523 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.731223 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.732189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.732637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.926458 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:15.927189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:15.933710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.934233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:15.935743 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:15.936306 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.030014 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:16.038954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-945f9149-6741-4ce9-952d-bcb13b577a55 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1210 microversion: 2.1 time: 0.116715 Jul 11 14:16:16.039531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 456/905] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:15 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:16.135359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-90fca579-f418-4ce5-9080-8cf0b5d95844 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424046 Jul 11 14:16:16.136273 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 450/906] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:16:15 2022] POST /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:16.386673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:16.388058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:16.394829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.395524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.398095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:16.398915 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:16.567264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:16.577116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:16.579243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:16.580805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dcf4aed7-967a-4499-adcc-98232e191c2a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.199116 Jul 11 14:16:16.591979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 457/907] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:16 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:17.057925 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:17.058726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:17.070501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.071537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.073064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.073656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.311522 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:17.322580 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e4834d16-1ac9-40b5-8000-c6d2381bf79f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.270074 Jul 11 14:16:17.333188 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 451/908] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:17 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:17.599461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:17.600080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:17.607629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.609333 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.610146 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.610645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.615047 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=85 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:17.669629 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-91025003-a6c8-4b3d-9fd6-23c80f279d94 req-5abfbf03-11db-460d-868d-f12876884d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2133fb7b-9f2f-4e3f-8d2c-73095a827fd4", "tag": "2c145e97-2662-4d53-8a43-00bf731245fc"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:17.693850 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-91025003-a6c8-4b3d-9fd6-23c80f279d94 req-5abfbf03-11db-460d-868d-f12876884d58 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:17.694430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-91025003-a6c8-4b3d-9fd6-23c80f279d94 req-5abfbf03-11db-460d-868d-f12876884d58 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:17.714293 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-91025003-a6c8-4b3d-9fd6-23c80f279d94 req-5abfbf03-11db-460d-868d-f12876884d58 service nova] Creating event network-changed:2c145e97-2662-4d53-8a43-00bf731245fc for instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 on hv-cinder-84842 Jul 11 14:16:17.761066 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-91025003-a6c8-4b3d-9fd6-23c80f279d94 req-5abfbf03-11db-460d-868d-f12876884d58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095958 Jul 11 14:16:17.761893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 452/909] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:17.798269 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:17.807621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:17.809293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:17.810524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b27d187d-5429-4e04-af88-41a574b7537f tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.215173 Jul 11 14:16:17.811104 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 458/910] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:17 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:18.344078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:18.345404 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:18.354184 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.355521 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.357425 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.358037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.508048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:18.516325 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3df426c2-5cb8-4e74-b2e5-28ca86886769 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.178410 Jul 11 14:16:18.516888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 453/911] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:18 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:18.828775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:18.829385 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:18.835407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.835853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.836615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:18.837045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:18.970564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:18.979152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:18.980638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:18.981784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-46803d01-9948-477c-9f4f-29f999d3a2b8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.157008 Jul 11 14:16:18.982388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 459/912] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:18 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:19.533209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:19.533770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:19.542218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:19.542696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:19.543484 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:19.543923 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:19.685423 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:19.693038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a022624a-8bbf-45f1-a4b4-5c16bff0efb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.163860 Jul 11 14:16:19.693616 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 454/913] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:19 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:19.998994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:19.999596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:20.005520 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:20.005962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:20.006748 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:20.007194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:20.154354 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:20.174674 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:20.183614 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:20.185120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:20.186277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f870a62a-2b3c-42df-b34f-b4bffabcc852 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1740 microversion: 2.20 time: 0.191182 Jul 11 14:16:20.186867 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 460/914] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:19 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:20.709306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:20.710013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:20.716556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:20.716998 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:20.717757 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:20.718189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:20.856436 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:20.864218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-09193064-6da5-42eb-8eac-6c76cbed0d4d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.158702 Jul 11 14:16:20.864794 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 455/915] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:20 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:21.205087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:21.205690 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:21.212334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:21.212786 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:21.213545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:21.213979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:21.345749 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:21.353818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:21.355367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:21.356526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5662a8c3-11a9-4e07-8ba3-98839f5f887d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1722 microversion: 2.20 time: 0.155381 Jul 11 14:16:21.357093 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 461/916] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:21 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:21.881764 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:21.882379 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:21.889503 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:21.889940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:21.890725 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:21.891160 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:22.023266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:22.030939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-285e2dbe-d21c-49dd-95f8-5a3f5a02a3b6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.153139 Jul 11 14:16:22.031508 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 456/917] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:21 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:22.302683 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-f6a12f84-831f-464b-8256-fc5bde4291b3 req-23b10ce0-076a-47f8-a8b9-6d2d5276d082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "name": "network-vif-unplugged", "status": "completed", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:22.311198 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f6a12f84-831f-464b-8256-fc5bde4291b3 req-23b10ce0-076a-47f8-a8b9-6d2d5276d082 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:22.311651 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f6a12f84-831f-464b-8256-fc5bde4291b3 req-23b10ce0-076a-47f8-a8b9-6d2d5276d082 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:22.322955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-f6a12f84-831f-464b-8256-fc5bde4291b3 req-23b10ce0-076a-47f8-a8b9-6d2d5276d082 service nova] Creating event network-vif-unplugged:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:16:22.327939 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-f6a12f84-831f-464b-8256-fc5bde4291b3 req-23b10ce0-076a-47f8-a8b9-6d2d5276d082 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029222 Jul 11 14:16:22.328534 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 462/918] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:22.375019 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:22.375628 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:22.381886 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:22.382361 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:22.383152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:22.383591 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:22.515035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:22.523074 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:22.525092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:22.526247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-34e69946-9d94-461d-9754-c10c57bd5ee7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1722 microversion: 2.20 time: 0.155330 Jul 11 14:16:22.526838 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 457/919] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:22 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:23.048155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:23.048933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:23.055514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.055962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.056734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.057172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.189818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:23.197237 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a672e472-b089-4ca7-9168-85aeb83bf618 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.153277 Jul 11 14:16:23.197803 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 463/920] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:23 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:23.543858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:23.544477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:23.551334 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.551786 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.552548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.552986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.688702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:23.698222 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:23.699782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:23.700979 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-85d04a65-6651-4226-9720-59a17ff0b09c tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1725 microversion: 2.20 time: 0.161068 Jul 11 14:16:23.701707 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 458/921] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:23 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:23.729032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6ef6dde-0b90-4b84-a66e-f20198479af3"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:23.730548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:23.737303 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:23.737987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.738337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:23.738615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.739464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.739976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.744452 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.745202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.746217 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.746683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.780981 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2c8707d3-1651-4c6b-adc4-4cfdeb84c9f6 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050156 Jul 11 14:16:23.781574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 459/922] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:16:23 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:23.791197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:23.791770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:23.799114 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=14 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:23.800329 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.800619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.801393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:23.802209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:23.836198 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-55f3462c-2338-4812-87f0-b11ee3040958 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/d81caf7b-6a54-4745-b2ff-4f5846989f93" status: 200 len: 194 microversion: 2.1 time: 0.048689 Jul 11 14:16:23.841149 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 460/923] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 11 14:16:23 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/d81caf7b-6a54-4745-b2ff-4f5846989f93 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:24.034328 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9d77097c-f53f-40c1-af64-44c6dba033bc tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318234 Jul 11 14:16:24.039766 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 464/924] 10.222.0.49 () {62 vars in 1363 bytes} [Mon Jul 11 14:16:23 2022] POST /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 11 14:16:24.163958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:24.165105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:24.171174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.171665 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.172512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.173199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.213928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:24.214744 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:24.220829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.221282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.222049 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.222528 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.362403 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:24.370536 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c810ba7b-5f4e-41f6-bdc7-b2fbafef734a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.160427 Jul 11 14:16:24.371103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 465/925] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:24 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:24.473515 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-75bf6bba-3c8b-4933-ab79-4176e7725fca tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-volume_attachments/d6ef6dde-0b90-4b84-a66e-f20198479af3" status: 202 len: 0 microversion: 2.20 time: 0.313609 Jul 11 14:16:24.474046 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 461/926] 10.222.0.49 () {60 vars in 1456 bytes} [Mon Jul 11 14:16:24 2022] DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-volume_attachments/d6ef6dde-0b90-4b84-a66e-f20198479af3 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:16:24.531071 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:24.531637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:24.537792 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.537954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.538686 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.539122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.627408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ead1ab4e-89db-40ba-b977-974ce422f460 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "POST /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/action" status: 202 len: 0 microversion: 2.20 time: 0.100318 Jul 11 14:16:24.628013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 466/927] 10.222.0.49 () {62 vars in 1318 bytes} [Mon Jul 11 14:16:24 2022] POST /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:16:24.636119 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:24.636726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:24.643895 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.644348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.645123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:24.645557 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:24.650447 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:24.783903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:24.793424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:24.795062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:24.796274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c5fed15b-a10e-40f1-88a2-6299586d2123 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1673 microversion: 2.20 time: 0.164112 Jul 11 14:16:24.796843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 462/928] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:24 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:25.170346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7920b547-a1ab-426d-a092-ae3fda0cfa07"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:25.171501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:25.177829 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:25.178276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:25.179058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:25.179485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:25.387482 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:25.388535 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:25.394635 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:25.395094 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:25.395868 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:25.396305 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:25.535010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:25.545339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-264dee18-40fa-4c58-9298-3db40b6b9d32 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.161565 Jul 11 14:16:25.546294 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 463/929] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:25 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:25.674125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-59ba7519-de2d-401e-ad3d-a620482aa373 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "POST /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507571 Jul 11 14:16:25.675123 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 467/930] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:16:25 2022] POST /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:25.815274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:25.815919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:25.823556 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:25.824127 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:25.825037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:25.825650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:25.967685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:25.979747 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:25.982669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:25.984360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8c368683-11d2-40f8-a0fd-f8bc4d6279b7 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1675 microversion: 2.20 time: 0.173120 Jul 11 14:16:25.984927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 464/931] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:25 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:26.564066 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:26.564820 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:26.572577 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:26.573277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:26.574129 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:26.574670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:26.716314 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:26.724277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a2f4b61a-9c9c-45e4-98b8-04e241f3b2c8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.164468 Jul 11 14:16:26.724890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 468/932] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:26 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:27.003249 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:27.003854 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:27.010461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:27.010908 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:27.011676 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:27.012109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:27.155008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:27.163444 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:27.165015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:27.166205 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9307d275-f96d-46e2-8cfc-295cd54b7d06 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.166895 Jul 11 14:16:27.166835 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 465/933] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:26 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:27.750640 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:27.751507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:27.758832 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:27.759379 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:27.760284 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:27.760785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:27.936491 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:27.945320 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fa2fc5f9-2661-4019-b371-bd2493048196 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.207665 Jul 11 14:16:27.945930 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 469/934] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:27 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:28.185696 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:28.186374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:28.193459 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:28.193830 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:28.194888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:28.195332 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:28.380987 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:28.390136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:28.392085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:28.393318 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bae68eff-9c35-4f7f-9d4d-f382d1563b42 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.211836 Jul 11 14:16:28.393890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 466/935] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:28 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:28.455240 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-5daef098-896a-4b8d-99b6-a0ff13ace555 req-e5925d39-c331-4225-b04f-12fe50077401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2133fb7b-9f2f-4e3f-8d2c-73095a827fd4", "name": "network-vif-plugged", "status": "completed", "tag": "2c145e97-2662-4d53-8a43-00bf731245fc"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:28.464816 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5daef098-896a-4b8d-99b6-a0ff13ace555 req-e5925d39-c331-4225-b04f-12fe50077401 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:28.465330 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-5daef098-896a-4b8d-99b6-a0ff13ace555 req-e5925d39-c331-4225-b04f-12fe50077401 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:28.481172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-5daef098-896a-4b8d-99b6-a0ff13ace555 req-e5925d39-c331-4225-b04f-12fe50077401 service nova] Creating event network-vif-plugged:2c145e97-2662-4d53-8a43-00bf731245fc for instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 on hv-cinder-84842 Jul 11 14:16:28.487399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-5daef098-896a-4b8d-99b6-a0ff13ace555 req-e5925d39-c331-4225-b04f-12fe50077401 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036121 Jul 11 14:16:28.488533 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 470/936] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:28.963834 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:28.964451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:28.966362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=56 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:28.972946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:28.973540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:28.975021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:28.975513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:29.130338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:29.138585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-64a67756-a9b9-4826-9e7b-dab2b0b680ba tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.180494 Jul 11 14:16:29.139179 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 467/937] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:28 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:29.412966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:29.413655 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:29.416459 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:29.422245 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:29.422722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:29.423494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:29.423928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:29.430477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:29.576195 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:29.581918 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:29.583517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:29.584720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-702007a5-9de4-4e25-927d-de56be803aef tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.176086 Jul 11 14:16:29.585599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 471/938] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:29 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:30.156090 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:30.156662 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:30.163530 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.163993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.164813 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.165254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.321920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:30.329722 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3523af3d-ffe7-401d-b7e9-e7141428d7bb tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.177510 Jul 11 14:16:30.330319 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 468/939] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:30 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:30.603645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:30.604426 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:30.610900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.611352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.612126 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:30.612562 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:30.766490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:30.774855 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:30.776369 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:30.777697 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6f81b22e-dde1-4f9d-b737-eee177436634 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.178339 Jul 11 14:16:30.778351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 472/940] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:30 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:31.348162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:31.348695 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:31.355823 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:31.356272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:31.357045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:31.357478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:31.504107 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:31.512857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-57b880cc-907c-4062-9ac6-324d08f29a80 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.168526 Jul 11 14:16:31.513464 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 469/941] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:31 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:31.797302 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:31.798828 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:31.807615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:31.808152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:31.809138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:31.809560 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:31.950130 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:31.958843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:31.960402 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:31.961599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9abd234f-6f6f-4cfc-8971-e8d3c21896d9 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.169135 Jul 11 14:16:31.962423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 473/942] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:31 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:32.534285 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:32.535554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:32.545770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:32.546467 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:32.547636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:32.548218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:32.707002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:32.715600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-677dfd71-c0cc-48ba-a957-ad2165fc6d11 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.189192 Jul 11 14:16:32.716195 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 470/943] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:32 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:32.980703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:32.983077 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:32.990926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:32.991377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:32.992860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:32.993557 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:33.155376 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:33.164850 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:33.166356 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:33.167709 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-66eaf2b3-ed76-43f8-8751-9f71adf32867 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.191653 Jul 11 14:16:33.168527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 474/944] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:32 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:33.735732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:33.736542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:33.745244 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:33.745746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:33.746702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:33.747380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:33.915040 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:33.923323 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-614d92ef-c969-49c4-82cf-7f2ee139473f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.193245 Jul 11 14:16:33.923913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 471/945] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:33 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:34.186410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:34.187046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:34.194215 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:34.194712 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:34.196160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:34.196599 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:34.343903 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:34.353107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:34.354672 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:34.355997 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fd90f04c-a4cf-440a-a1cd-5cbd6e797006 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.173465 Jul 11 14:16:34.356818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 475/946] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:34 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:34.945453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:34.946170 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:34.954543 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:34.954984 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:34.955797 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:34.957377 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:35.141250 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:35.154526 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d1873ecf-1dee-4aae-a82d-ed3d67b72b37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.212574 Jul 11 14:16:35.155546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 472/947] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:34 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:35.375080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:35.375808 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:35.383514 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:35.383960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:35.384731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:35.385163 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:35.544401 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:35.559096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:35.562924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:35.564945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fabbf1a8-314a-4e76-8c37-e1cd5bea93a5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.193670 Jul 11 14:16:35.566212 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 476/948] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:35 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:36.179814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:36.180420 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:36.189976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:36.190453 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:36.191231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:36.191673 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:36.325475 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:36.333092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e0a65804-f005-4726-b7dd-345eda6e75dd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.158183 Jul 11 14:16:36.333669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 473/949] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:36 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:36.583848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:36.584394 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:36.591112 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:36.591564 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:36.592345 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:36.592787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:36.729733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:36.737613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:36.739138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:36.740285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-21cb52bb-ceaa-4105-af80-81d011de6ca3 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.160578 Jul 11 14:16:36.740828 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 477/950] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:36 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:37.350805 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:37.351913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:37.358762 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:37.359216 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:37.360008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:37.360446 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:37.500289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:37.508255 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-48004d11-aae2-4ee3-bcdf-252468fce4b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.161313 Jul 11 14:16:37.508845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 474/951] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:37 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:37.760477 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:37.761044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:37.767807 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:37.768256 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:37.769043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:37.769473 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:37.905172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:37.914759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:37.916203 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:37.917422 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0174efb8-8aca-4614-971c-887eeefe1367 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.161411 Jul 11 14:16:37.918005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 478/952] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:37 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:38.525356 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:38.525980 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:38.533199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:38.533659 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:38.534481 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:38.534928 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:38.677061 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:38.685852 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5cf785c7-d9e4-4d7e-a658-12ffdb76dd22 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.164387 Jul 11 14:16:38.686495 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 475/953] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:38 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:16:38.937041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:38.937917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:38.944688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:38.945666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:38.946513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:38.946961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:39.099121 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:39.107784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:39.109400 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:39.111232 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-146671f8-adea-4e91-b677-5ada9285ee29 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.178072 Jul 11 14:16:39.111919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 479/954] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:38 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:39.708941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:39.709617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:39.717166 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:39.717620 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:39.718438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:39.718883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:39.867373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:39.876373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8777b90a-43ff-4878-ab8d-3c4bffd28ae8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.171308 Jul 11 14:16:39.876978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 476/955] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:39 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:40.135802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:40.136626 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:40.143391 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:40.143842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:40.144627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:40.145062 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:40.283574 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:40.292384 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:40.293953 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:40.295202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3e68055f-0098-44a1-a5c6-6b9f48200901 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.164156 Jul 11 14:16:40.295790 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 480/956] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:40 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:40.895543 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:40.896154 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:40.903793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:40.904247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:40.905037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:40.905485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:41.066672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:41.075822 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-569c9283-3f45-4309-bbe8-f99128821027 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.184129 Jul 11 14:16:41.076431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 477/957] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:40 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:41.315898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:41.316466 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:41.323937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:41.324384 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:41.325170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:41.325611 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:41.461300 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:41.470256 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:41.471840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:41.473168 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-94b95bf7-f644-4cfc-b1cd-cab7e359259d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.161307 Jul 11 14:16:41.473854 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 481/958] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:41 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:42.093068 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:42.093670 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:42.100587 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.101037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.101832 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.102269 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.252762 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:42.256844 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=100 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:42.264731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5e4bf8cb-92ee-4242-bf9d-54df1c1d1a37 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.175206 Jul 11 14:16:42.266013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 478/959] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:42 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:42.491668 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:42.492900 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:42.499757 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.500204 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.500981 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:42.501420 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:42.659931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:42.676039 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:42.679122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:42.681993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4d611638-6bdb-4c78-b9a6-33c58624be0d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.193844 Jul 11 14:16:42.682877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 482/960] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:42 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:43.285126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:43.285746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:43.293389 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.293837 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.294810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.295333 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.462941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:43.475999 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2dfa8892-6393-48ec-bc45-9ba4735139db tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.195411 Jul 11 14:16:43.476959 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 479/961] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:43 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:43.705150 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:43.705768 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:43.713343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.713802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.714620 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.715061 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.868138 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:43.880852 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:43.883543 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:43.885041 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-11f096e1-d109-4fe1-a982-969bc702fe25 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.183688 Jul 11 14:16:43.885685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 483/962] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:43 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:43.954958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:43.956042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:43.963035 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.963645 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:43.964565 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:43.965123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.001260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-84e471c3-8169-4bb7-ad07-5dbb83c62128 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050416 Jul 11 14:16:44.001864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 480/963] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:16:43 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:44.155761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:44.156572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:44.167199 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.167833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.169162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.169935 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.205637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-58f88b98-6a7b-48ee-a6d5-82d35d44d605 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/d81caf7b-6a54-4745-b2ff-4f5846989f93" status: 200 len: 194 microversion: 2.1 time: 0.056885 Jul 11 14:16:44.206389 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 484/964] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 11 14:16:44 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/d81caf7b-6a54-4745-b2ff-4f5846989f93 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:44.216932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:44.217454 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:44.224096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.224563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.225371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.225813 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.318392 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lazy-loading 'services' on Instance uuid dd1cc077-6cee-4ff4-9fa8-d44584daa613 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:16:44.431829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c05f3b90-26b6-4183-b3f5-2ddb27e995e5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/d81caf7b-6a54-4745-b2ff-4f5846989f93" status: 202 len: 0 microversion: 2.1 time: 0.218986 Jul 11 14:16:44.432616 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 481/965] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:16:44 2022] DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/d81caf7b-6a54-4745-b2ff-4f5846989f93 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:16:44.494775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:44.495787 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:44.502992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.503530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.504410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.504952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.546347 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-2537a097-1862-4829-a26f-1c455fc1f58c req-97595988-4029-46db-b40e-3fdbc826fd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "name": "network-vif-plugged", "status": "completed", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:44.566339 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-2537a097-1862-4829-a26f-1c455fc1f58c req-97595988-4029-46db-b40e-3fdbc826fd52 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.566790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-2537a097-1862-4829-a26f-1c455fc1f58c req-97595988-4029-46db-b40e-3fdbc826fd52 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.578437 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-2537a097-1862-4829-a26f-1c455fc1f58c req-97595988-4029-46db-b40e-3fdbc826fd52 service nova] Creating event network-vif-plugged:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:16:44.583472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-2537a097-1862-4829-a26f-1c455fc1f58c req-97595988-4029-46db-b40e-3fdbc826fd52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047346 Jul 11 14:16:44.584088 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 482/966] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:44.672445 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:44.680360 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b3fba5ca-3141-4221-870b-e302f19b6cf7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1265 microversion: 2.1 time: 0.189584 Jul 11 14:16:44.680928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 485/967] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:44 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:44.904708 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:44.905399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:44.911726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.912173 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:44.912936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:44.913362 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:45.048575 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:45.058639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:45.060883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:45.062086 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4983fc33-c65a-429c-ad7c-735235ad3796 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.161761 Jul 11 14:16:45.062669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 483/968] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:44 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 11 14:16:45.697028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:45.697805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:45.704449 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:45.704898 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:45.705656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:45.706088 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:45.843048 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:45.850648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d9d3440e-0740-4c60-8cf9-a4e39e286975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1452 microversion: 2.1 time: 0.157480 Jul 11 14:16:45.851722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 486/969] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:45 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:45.868106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:45.868711 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:45.875973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:45.876650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:45.877752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:45.878199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.021015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:46.028952 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-59a42f0f-c651-418f-a0f5-5fd56b52bb69 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1452 microversion: 2.1 time: 0.165382 Jul 11 14:16:46.029506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 484/970] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:45 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:46.081067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:46.081692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:46.088351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.088953 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.090182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.090957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.264086 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:46.267517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=100 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.273844 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:46.275412 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:46.276573 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-548c5638-ad40-49b4-afd5-b521309b8a96 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.199716 Jul 11 14:16:46.277147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 487/971] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:46 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:46.627968 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:46.628610 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:46.635479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.636038 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.636873 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.637383 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.667078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7c207588-a5fc-40cf-b01c-9c3d12581abb tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/7920b547-a1ab-426d-a092-ae3fda0cfa07" status: 200 len: 194 microversion: 2.1 time: 0.043045 Jul 11 14:16:46.667675 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 485/972] 10.222.0.49 () {58 vars in 1412 bytes} [Mon Jul 11 14:16:46 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/7920b547-a1ab-426d-a092-ae3fda0cfa07 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:16:46.678872 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:46.679395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:46.687071 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.687643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.688571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:46.689076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:46.772681 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lazy-loading 'services' on Instance uuid dd1cc077-6cee-4ff4-9fa8-d44584daa613 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:16:46.847841 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-afa44911-d537-43ef-9194-cf511551f3bf tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/7920b547-a1ab-426d-a092-ae3fda0cfa07" status: 202 len: 0 microversion: 2.1 time: 0.173794 Jul 11 14:16:46.848741 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 488/973] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:16:46 2022] DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments/7920b547-a1ab-426d-a092-ae3fda0cfa07 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:16:47.295381 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:47.295991 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:47.303429 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:47.303874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:47.304640 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:47.305261 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:47.440338 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:47.449487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:47.451049 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:47.452232 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7ec5409d-aa98-4b71-8be8-24dd68381d0a tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1731 microversion: 2.20 time: 0.160852 Jul 11 14:16:47.452798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 486/974] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:47 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:47.874988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b90e867c-9262-4fc8-ae85-76b58ec7b3c2 req-5e4b7351-c3cc-44dc-85c0-64174550de42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2133fb7b-9f2f-4e3f-8d2c-73095a827fd4", "tag": "2c145e97-2662-4d53-8a43-00bf731245fc"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:47.886662 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b90e867c-9262-4fc8-ae85-76b58ec7b3c2 req-5e4b7351-c3cc-44dc-85c0-64174550de42 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:47.887066 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b90e867c-9262-4fc8-ae85-76b58ec7b3c2 req-5e4b7351-c3cc-44dc-85c0-64174550de42 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:47.900572 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b90e867c-9262-4fc8-ae85-76b58ec7b3c2 req-5e4b7351-c3cc-44dc-85c0-64174550de42 service nova] Creating event network-changed:2c145e97-2662-4d53-8a43-00bf731245fc for instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 on hv-cinder-84842 Jul 11 14:16:47.906364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b90e867c-9262-4fc8-ae85-76b58ec7b3c2 req-5e4b7351-c3cc-44dc-85c0-64174550de42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036198 Jul 11 14:16:47.907509 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 489/975] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:48.472343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:48.472942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:48.482613 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:48.483059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:48.483858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:48.484477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:48.645012 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:48.653613 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:48.655149 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:48.656309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-fada7e18-94ff-4fe6-995a-a4779ad5bc36 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1718 microversion: 2.20 time: 0.188715 Jul 11 14:16:48.657039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 487/976] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:16:48 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1718 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:16:49.076132 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:49.077184 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:49.084192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.084648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.085931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.086406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.118035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c7928212-148d-4ee0-87d1-81c22018562b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046291 Jul 11 14:16:49.118647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 490/977] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:16:49 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:16:49.231096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:49.232126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:49.238609 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.239247 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.240067 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.240513 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.271458 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2faf5616-c655-4e53-8553-704838db703f tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044927 Jul 11 14:16:49.272313 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 488/978] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:16:49 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 11 14:16:49.333909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:49.334427 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:49.340895 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.341335 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.342087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.342571 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.368054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:16:49.448665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-18093533-cbfe-45de-bf0a-cfd01a70af2d tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 204 len: 0 microversion: 2.1 time: 0.118261 Jul 11 14:16:49.449280 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 491/979] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:16:49 2022] DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:16:49.457477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:49.458092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:49.464718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.465174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.465935 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:49.466403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:49.595563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:49.603119 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c73a40b8-5b1b-4696-bb8d-0f24ceac5bed tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1671 microversion: 2.1 time: 0.149424 Jul 11 14:16:49.603693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 489/980] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:49 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:50.620751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:50.621453 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:50.627987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:50.628439 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:50.629203 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:50.629636 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:50.763827 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:50.772137 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1e96d07e-1e1e-4485-9ea4-4f39bec4e1b5 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1671 microversion: 2.1 time: 0.155270 Jul 11 14:16:50.773324 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 492/981] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:50 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:51.789752 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:51.790542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:51.797471 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:51.798020 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:51.798907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:51.799447 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:52.013895 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:52.023537 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a2279cc2-9a34-4342-a97f-723c95523a16 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1671 microversion: 2.1 time: 0.237664 Jul 11 14:16:52.024122 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 490/982] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:51 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:52.766644 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-ead9c21f-e78d-4680-9834-efec34115d0a req-194bef8e-4a00-4c4b-80f6-5a3780b5a291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd1cc077-6cee-4ff4-9fa8-d44584daa613", "name": "network-vif-deleted", "tag": "7fd0c458-b02e-405a-a868-f08fece32cb4"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:16:52.776141 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ead9c21f-e78d-4680-9834-efec34115d0a req-194bef8e-4a00-4c4b-80f6-5a3780b5a291 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:52.776605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ead9c21f-e78d-4680-9834-efec34115d0a req-194bef8e-4a00-4c4b-80f6-5a3780b5a291 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:52.788346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-ead9c21f-e78d-4680-9834-efec34115d0a req-194bef8e-4a00-4c4b-80f6-5a3780b5a291 service nova] Creating event network-vif-deleted:7fd0c458-b02e-405a-a868-f08fece32cb4 for instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 on hv-cinder-84842 Jul 11 14:16:52.794059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-ead9c21f-e78d-4680-9834-efec34115d0a req-194bef8e-4a00-4c4b-80f6-5a3780b5a291 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031544 Jul 11 14:16:52.794930 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 493/983] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:16:53.044737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:53.045272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:53.052517 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:53.053062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:53.053918 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:53.055036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:53.093066 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:53.093516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:53.093973 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lazy-loading 'fault' on Instance uuid dd1cc077-6cee-4ff4-9fa8-d44584daa613 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:16:53.137888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296853a88430438e96e0f8fb97b46d2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a772cbaa461c416da2cc35e364541ecf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:16:53.145914 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e45c6cdd-e342-41ce-8557-9daf1cf06d8a tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 200 len: 1328 microversion: 2.1 time: 0.108583 Jul 11 14:16:53.146507 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 491/984] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:53 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:16:54.172224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:54.172923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:54.180170 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:54.180623 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:54.181407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:54.181846 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:54.195955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] HTTP exception thrown: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Request method failure captured: Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 HTTP/1.1 Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6JIjpkL2t-MSPfeIa2lQhawqMgbLl30Z8smVh-jLeIXMbWUfdxS1pKSvDi2ZjaKCMk0VqZzp9sTWuCnP2DD5usRBI6KukWxZGLjqk5t7aQ5OUEeKeBhq0VNh8k-T96PjfVN2q0nx-WavoKWV8unDKKlLQ8p8LNUIZ6rjARO3-gLqQ Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:16:54.197531 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a772cbaa461c416da2cc35e364541ecf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}] Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 296853a88430438e96e0f8fb97b46d2e Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:54.199192 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'dd1cc077-6cee-4ff4-9fa8-d44584daa613'} Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:16:54.200286 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:54.201825 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:54.203416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Returning 404 to user: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:16:54.203416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a7753370-1e34-4c93-894b-eff976c8b972 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 404 len: 111 microversion: 2.1 time: 0.031723 Jul 11 14:16:54.203416 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 494/985] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:54 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:54.207926 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-16b0b337-0175-4e38-8628-b46b5e815cd4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '.version_select at 0x7ffad51c34c0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:54.227438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-16b0b337-0175-4e38-8628-b46b5e815cd4 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212780136" status: 202 len: 0 microversion: 2.1 time: 0.023212 Jul 11 14:16:54.228017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 492/986] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 11 14:16:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212780136 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:16:57.118265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:57.118784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:57.124985 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:57.125425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:57.126167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:57.126622 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:57.140255 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] HTTP exception thrown: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Request method failure captured: Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 HTTP/1.1 Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6JIjpkL2t-MSPfeIa2lQhawqMgbLl30Z8smVh-jLeIXMbWUfdxS1pKSvDi2ZjaKCMk0VqZzp9sTWuCnP2DD5usRBI6KukWxZGLjqk5t7aQ5OUEeKeBhq0VNh8k-T96PjfVN2q0nx-WavoKWV8unDKKlLQ8p8LNUIZ6rjARO3-gLqQ Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:16:57.142117 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a772cbaa461c416da2cc35e364541ecf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}] Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 296853a88430438e96e0f8fb97b46d2e Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.143733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'dd1cc077-6cee-4ff4-9fa8-d44584daa613'} Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:16:57.144645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.146133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.147685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Returning 404 to user: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:16:57.147685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8769a921-2e5b-4271-81fa-c3e6d22a925b tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 404 len: 111 microversion: 2.1 time: 0.029032 Jul 11 14:16:57.147685 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 495/987] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:16:57 2022] DELETE /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:57.153225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:57.153785 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: dd1cc077-6cee-4ff4-9fa8-d44584daa613] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:57.159810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:57.160264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:57.161037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:57.161479 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:57.175078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] HTTP exception thrown: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Request method failure captured: Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 HTTP/1.1 Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6JIjpkL2t-MSPfeIa2lQhawqMgbLl30Z8smVh-jLeIXMbWUfdxS1pKSvDi2ZjaKCMk0VqZzp9sTWuCnP2DD5usRBI6KukWxZGLjqk5t7aQ5OUEeKeBhq0VNh8k-T96PjfVN2q0nx-WavoKWV8unDKKlLQ8p8LNUIZ6rjARO3-gLqQ Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:16:57.176768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a772cbaa461c416da2cc35e364541ecf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}] Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 296853a88430438e96e0f8fb97b46d2e Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.178360 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'dd1cc077-6cee-4ff4-9fa8-d44584daa613'} Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:16:57.179259 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. Jul 11 14:16:57.180793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:57.182110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Returning 404 to user: Instance dd1cc077-6cee-4ff4-9fa8-d44584daa613 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:16:57.182110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-90fbc412-c4dc-4c42-83d8-5fe5b5486ff2 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jul 11 14:16:57.182110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 493/988] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:57 2022] GET /compute/v2.1/servers/dd1cc077-6cee-4ff4-9fa8-d44584daa613 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:58.307605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:58.308122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:58.314522 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:58.314949 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:58.315727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:58.316153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:58.331288 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] HTTP exception thrown: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Request method failure captured: Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 HTTP/1.1 Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6JIjpkL2t-MSPfeIa2lQhawqMgbLl30Z8smVh-jLeIXMbWUfdxS1pKSvDi2ZjaKCMk0VqZzp9sTWuCnP2DD5usRBI6KukWxZGLjqk5t7aQ5OUEeKeBhq0VNh8k-T96PjfVN2q0nx-WavoKWV8unDKKlLQ8p8LNUIZ6rjARO3-gLqQ Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:16:58.332779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a772cbaa461c416da2cc35e364541ecf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}] Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 296853a88430438e96e0f8fb97b46d2e Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.334322 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'e4c538a6-c82b-4cc8-be39-aecd9c223140'} Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:16:58.335229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.336407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.337600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Returning 404 to user: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:16:58.337600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d60da4ae-b0d5-4c85-9f52-0ba6e65b4563 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 404 len: 111 microversion: 2.1 time: 0.030835 Jul 11 14:16:58.337600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 496/989] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:16:58 2022] DELETE /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:58.342600 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:16:58.343243 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] [instance: e4c538a6-c82b-4cc8-be39-aecd9c223140] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:16:58.349965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:58.350464 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:58.351723 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:16:58.352161 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:16:58.365413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] HTTP exception thrown: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Request method failure captured: Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 HTTP/1.1 Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6JIjpkL2t-MSPfeIa2lQhawqMgbLl30Z8smVh-jLeIXMbWUfdxS1pKSvDi2ZjaKCMk0VqZzp9sTWuCnP2DD5usRBI6KukWxZGLjqk5t7aQ5OUEeKeBhq0VNh8k-T96PjfVN2q0nx-WavoKWV8unDKKlLQ8p8LNUIZ6rjARO3-gLqQ Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:16:58.367647 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a772cbaa461c416da2cc35e364541ecf", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a772cbaa461c416da2cc35e364541ecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a772cbaa461c416da2cc35e364541ecf"}]}] Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: a772cbaa461c416da2cc35e364541ecf Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711771340 Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 296853a88430438e96e0f8fb97b46d2e Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeTestJSON-1711771340-project Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.369372 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'e4c538a6-c82b-4cc8-be39-aecd9c223140'} Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:16:58.370358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. Jul 11 14:16:58.371846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:16:58.373414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] Returning 404 to user: Instance e4c538a6-c82b-4cc8-be39-aecd9c223140 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:16:58.373414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4dae3e30-7a17-460f-8194-466b41dc6b68 tempest-AttachVolumeTestJSON-1711771340 tempest-AttachVolumeTestJSON-1711771340-project] 10.222.0.49 "GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140" status: 404 len: 111 microversion: 2.1 time: 0.030375 Jul 11 14:16:58.373414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 494/990] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:16:58 2022] GET /compute/v2.1/servers/e4c538a6-c82b-4cc8-be39-aecd9c223140 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:06.782545 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:06.783141 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:06.785735 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:06.793221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:06.793641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:06.794525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:06.794873 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:06.819627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-7d87f7bd-376d-480b-baf4-9dec97ed984c tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/ips" status: 200 len: 148 microversion: 2.1 time: 0.041205 Jul 11 14:17:06.820209 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 497/991] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:17:06 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:08.155564 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04fc16a5-0165-435c-be80-de844de6ad3d"}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:08.156648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:08.158932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:08.165106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:08.165561 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:08.166357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:08.166863 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:08.444271 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-711aebf1-f9f7-4705-8f19-6e45d1d6afb4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "POST /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292648 Jul 11 14:17:08.445698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 495/992] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:17:08 2022] POST /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:16.049167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:16.049728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:16.056363 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.056808 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.057602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.058038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.248732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lazy-loading 'services' on Instance uuid a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:17:16.319347 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-16985bde-3066-4553-be6b-f0dbc532e357 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments/04fc16a5-0165-435c-be80-de844de6ad3d" status: 202 len: 0 microversion: 2.1 time: 0.274431 Jul 11 14:17:16.320466 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 498/993] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:17:16 2022] DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments/04fc16a5-0165-435c-be80-de844de6ad3d => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:17:16.330795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:16.331461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:16.338552 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.338992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.339760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:16.340190 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:16.342814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:16.371034 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0ffa0cd1-5558-48ec-ab45-dd9442919646 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 Jul 11 14:17:16.371500 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 496/994] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:17:16 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:17.384626 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:17.385716 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:17.392457 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.392904 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.393669 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.394102 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.396557 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:17.425354 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d12accd8-a0d0-4d5f-b6d4-76c108858dda tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045881 Jul 11 14:17:17.426016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 499/995] 10.222.0.49 () {58 vars in 1301 bytes} [Mon Jul 11 14:17:17 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 11 14:17:17.486154 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:17.486719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:17.493346 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.493793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.494626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.495240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.522364 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:17:17.602199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9eddb29a-a83d-4b9a-bc58-b5288ba90ae4 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 204 len: 0 microversion: 2.1 time: 0.119107 Jul 11 14:17:17.603138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 497/996] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:17:17 2022] DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:17:17.612777 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:17.613390 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:17.619468 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.620203 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.620974 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:17.621411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:17.752739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:17.761879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9bb97960-db5f-4fd4-a14a-388b2351e75d tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1679 microversion: 2.1 time: 0.154238 Jul 11 14:17:17.762478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 500/997] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:17 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:18.780399 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:18.781111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:18.787724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.788180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.788964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:18.789390 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:18.919895 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:18.927821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-77fa2c5c-51d7-4921-b739-f95e856b569f tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1679 microversion: 2.1 time: 0.151658 Jul 11 14:17:18.928387 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 498/998] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:18 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:19.945454 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:19.946285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:19.952992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:19.953615 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:19.955067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:19.955759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:20.092350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e86369906d4633b02a5ca1bcc24b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da749564df7941929c6cb9159479d637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:20.099850 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f0f63182-b0de-48d6-992a-96d6180fb5b0 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 200 len: 1679 microversion: 2.1 time: 0.158656 Jul 11 14:17:20.100427 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 501/999] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:19 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:20.493772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-d7785b91-eba3-4680-bc59-a1dc454c01ae req-a779bd2f-86a0-4906-9fdd-e76131a4b5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a79701d5-dc0a-4c8d-a9b4-a47b950b77a7", "name": "network-vif-deleted", "tag": "baff141b-1b0c-403d-ab6d-3fa5acfe54af"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:20.503409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-d7785b91-eba3-4680-bc59-a1dc454c01ae req-a779bd2f-86a0-4906-9fdd-e76131a4b5e1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:20.503843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-d7785b91-eba3-4680-bc59-a1dc454c01ae req-a779bd2f-86a0-4906-9fdd-e76131a4b5e1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:20.522189 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-d7785b91-eba3-4680-bc59-a1dc454c01ae req-a779bd2f-86a0-4906-9fdd-e76131a4b5e1 service nova] Creating event network-vif-deleted:baff141b-1b0c-403d-ab6d-3fa5acfe54af for instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 on hv-cinder-84842 Jul 11 14:17:20.527566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-d7785b91-eba3-4680-bc59-a1dc454c01ae req-a779bd2f-86a0-4906-9fdd-e76131a4b5e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037974 Jul 11 14:17:20.528264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 499/1000] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:21.117583 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:21.120637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:21.128319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:21.128771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:21.129553 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:21.129994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:21.144256 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 HTTP/1.1 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:21.145877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:21.147341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'a79701d5-dc0a-4c8d-a9b4-a47b950b77a7'} Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:21.148418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:21.150629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:21.152051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:21.152051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bcb80100-b1b9-4822-88b1-9980ee0feaa5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 404 len: 111 microversion: 2.1 time: 0.034109 Jul 11 14:17:21.152051 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 502/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:21 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:21.157674 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f13ef92e-525a-465f-8372-c3c2fc91b7f8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '.version_select at 0x7ffad54f8280>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:21.179051 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f13ef92e-525a-465f-8372-c3c2fc91b7f8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080024710" status: 202 len: 0 microversion: 2.1 time: 0.025044 Jul 11 14:17:21.179611 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 500/1002] 10.222.0.49 () {58 vars in 1220 bytes} [Mon Jul 11 14:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2080024710 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:17:22.946501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:22.947035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:22.953364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:22.953808 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:22.954581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:22.955011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:22.968549 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 HTTP/1.1 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:22.970054 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:22.971682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'a79701d5-dc0a-4c8d-a9b4-a47b950b77a7'} Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:22.972755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:22.974263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:22.975853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:22.975853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-646b050c-bb93-436b-98f1-454363d3a84a tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 404 len: 111 microversion: 2.1 time: 0.029107 Jul 11 14:17:22.975853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 503/1003] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:17:22 2022] DELETE /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:22.981008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:22.981760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: a79701d5-dc0a-4c8d-a9b4-a47b950b77a7] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:22.987904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:22.988354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:22.989138 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:22.989680 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:23.003206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 HTTP/1.1 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:23.004829 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:23.006386 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'a79701d5-dc0a-4c8d-a9b4-a47b950b77a7'} Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:23.007433 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. Jul 11 14:17:23.008900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:23.010192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:23.010192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-68a2d50a-3833-40c4-9044-aa944b4176f3 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7" status: 404 len: 111 microversion: 2.1 time: 0.030159 Jul 11 14:17:23.010192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 501/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:22 2022] GET /compute/v2.1/servers/a79701d5-dc0a-4c8d-a9b4-a47b950b77a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:24.308414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:24.308948 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:24.316500 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.316955 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.317742 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.318731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.332677 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 HTTP/1.1 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:24.334216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.335837 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '21851a9e-91d2-4ced-87e9-abedb3c03835'} Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:24.336727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.338293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.339687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:24.339687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5205c830-ad41-4442-b356-c16e37f4eca5 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 404 len: 111 microversion: 2.1 time: 0.031691 Jul 11 14:17:24.339687 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 504/1005] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:17:24 2022] DELETE /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:17:24.344141 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:24.344754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 21851a9e-91d2-4ced-87e9-abedb3c03835] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:24.351353 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.351810 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.352587 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.353029 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.367053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 HTTP/1.1 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:24.368594 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.370218 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '21851a9e-91d2-4ced-87e9-abedb3c03835'} Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:24.371207 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. Jul 11 14:17:24.372788 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.374021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance 21851a9e-91d2-4ced-87e9-abedb3c03835 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:24.374021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-e6fbbcaa-dbea-4c2e-a2d6-7d1fb59732ed tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835" status: 404 len: 111 microversion: 2.1 time: 0.029742 Jul 11 14:17:24.374021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 502/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:24 2022] GET /compute/v2.1/servers/21851a9e-91d2-4ced-87e9-abedb3c03835 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:24.380458 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:24.380951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:24.387250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.387693 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.388461 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.388896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.402821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c HTTP/1.1 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:24.404351 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.405753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '619764ad-475f-4665-85d2-dfb69d85fa1c'} Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:24.406584 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.407795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.408998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:24.408998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-968c2644-3ce0-4718-a0b8-8a81926e86b8 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 404 len: 111 microversion: 2.1 time: 0.029155 Jul 11 14:17:24.408998 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 505/1007] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:17:24 2022] DELETE /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:24.415849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:24.416582 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: 619764ad-475f-4665-85d2-dfb69d85fa1c] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:24.423337 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.423857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.425231 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:24.425548 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:24.439871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c HTTP/1.1 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:24.442789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.444175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '619764ad-475f-4665-85d2-dfb69d85fa1c'} Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:24.445487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. Jul 11 14:17:24.446801 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:24.448023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance 619764ad-475f-4665-85d2-dfb69d85fa1c could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:24.448023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8bcf880a-ca85-489a-a620-2585f5628649 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c" status: 404 len: 111 microversion: 2.1 time: 0.032793 Jul 11 14:17:24.448023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 503/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:24 2022] GET /compute/v2.1/servers/619764ad-475f-4665-85d2-dfb69d85fa1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:25.592434 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:25.593025 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:25.599933 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:25.600379 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:25.601662 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:25.602098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:25.620025 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb HTTP/1.1 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:25.621601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.623346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'b2bf941c-f166-4236-b1dc-c7943dfa23cb'} Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:25.624698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.626627 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.629752 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:25.630830 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0de71ff6-eb73-4b3c-aab1-7018ae7e1a47 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 404 len: 111 microversion: 2.1 time: 0.042914 Jul 11 14:17:25.631408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 506/1009] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:17:25 2022] DELETE /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:25.639545 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:25.640268 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] [instance: b2bf941c-f166-4236-b1dc-c7943dfa23cb] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:25.646827 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:25.647358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:25.648523 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:25.648965 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:25.662743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] HTTP exception thrown: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Request method failure captured: Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb HTTP/1.1 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6FXt2BQ2JdIGE06BRjxCBLlA_RYIMNXOlaDfTPPbkddWr5PWSbjlEmsmgtsYooBeuI5ySOmStlU9K-T1XWCLODnkMNRfW7Fa-GjWVnWIk-3EHTiXKc0Bjp4H3jciqVxZ8VDMJlsipFxFKTQhHFVcGPHoPlq4_QNdSzRZkBzJirj80 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:25.664811 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_da749564df7941929c6cb9159479d637", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/da749564df7941929c6cb9159479d637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/da749564df7941929c6cb9159479d637"}]}] Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: da749564df7941929c6cb9159479d637 Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1691287342 Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 04e86369906d4633b02a5ca1bcc24b35 Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeNegativeTest-1691287342-project Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.666246 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'b2bf941c-f166-4236-b1dc-c7943dfa23cb'} Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:25.667106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. Jul 11 14:17:25.669025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:25.670435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] Returning 404 to user: Instance b2bf941c-f166-4236-b1dc-c7943dfa23cb could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:25.670435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6f108dbc-b9e8-4eee-8c69-90e094ba5293 tempest-AttachVolumeNegativeTest-1691287342 tempest-AttachVolumeNegativeTest-1691287342-project] 10.222.0.49 "GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb" status: 404 len: 111 microversion: 2.1 time: 0.030626 Jul 11 14:17:25.670435 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 504/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:25 2022] GET /compute/v2.1/servers/b2bf941c-f166-4236-b1dc-c7943dfa23cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:28.781886 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-412729821", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "networks": [{"uuid": "2732531a-d3b6-48a8-b1d1-0ab620f2a389"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:28.837508 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] validate_networks() for [('2732531a-d3b6-48a8-b1d1-0ab620f2a389', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:17:29.445510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:17:29.446125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:17:29.446617 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:17:29.447022 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:17:29.447451 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:17:29.468034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:29.468583 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:29.469678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:29.470233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:29.493723 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Getting quotas for project 9a7d950a8bf049dcb5600fc64b3b6cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:17:29.500048 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Getting quotas for user 9ae9e78d25e94319801ce906327ada27 and project 9a7d950a8bf049dcb5600fc64b3b6cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:17:29.512756 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:17:29.515094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:17:29.559728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a5dc050-1ed2-4a99-bcb3-747097c2235a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781400 Jul 11 14:17:29.560269 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 507/1011] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:17:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:17:29.571136 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0af9b4bc-ad47-44e6-8ac0-f75f41f9d0ba tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:29.571754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0af9b4bc-ad47-44e6-8ac0-f75f41f9d0ba tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:29.638860 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0af9b4bc-ad47-44e6-8ac0-f75f41f9d0ba tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:29.647412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0af9b4bc-ad47-44e6-8ac0-f75f41f9d0ba tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1213 microversion: 2.1 time: 0.081140 Jul 11 14:17:29.648096 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 505/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:29 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:30.638169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d919089b-e50f-4296-ad25-55a63c7a2179 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Action: 'create', calling method: .version_select at 0x7ffad50bba60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1202725484", "metadata": {"Type": "work"}}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:30.665102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:30.666627 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d919089b-e50f-4296-ad25-55a63c7a2179 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Request method failure captured: Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 122 Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD6xpXq5tSsmqKtHSnUhEAJjeoVsm5xjFB46LDRE80gwvR0Sw-bv4DOPK-CIdMvDjJfBnyEgA-3CvFHEFBfd106VpBw5e08KcVWHDmlJpvbmqgCHO3oJI_M3j_aIHCiZ5CYJMWvB86VE9hkBf6Knf5bCHrwGXQLF11UiYXkq69Z2MQ Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:30.667140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2bb24cc72064066b16a7321bbe0c1d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}] Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 2d80b3c2b07b4684a81e11d7e528fdc3 Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1202725484", "metadata": {"Type": "work"}}} Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:17:30.668494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1202725484', 'metadata': {'Type': 'work'}}}} Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise error Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi '#$%' Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:30.669321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 14:17:30.671364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 14:17:30.672966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 11 14:17:30.672966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.672966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d919089b-e50f-4296-ad25-55a63c7a2179 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:30.672966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d919089b-e50f-4296-ad25-55a63c7a2179 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154568 Jul 11 14:17:30.672966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 508/1013] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 11 14:17:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:17:30.680721 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1a060e88-df5c-4be6-8d34-aba7c7f877f5 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Action: 'create', calling method: .version_select at 0x7ffad55eb700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-398556454", "metadata": {"Type": "work"}}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:30.682183 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:30.682655 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:30.683437 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1a060e88-df5c-4be6-8d34-aba7c7f877f5 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Request method failure captured: Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 119 Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD6xpXq5tSsmqKtHSnUhEAJjeoVsm5xjFB46LDRE80gwvR0Sw-bv4DOPK-CIdMvDjJfBnyEgA-3CvFHEFBfd106VpBw5e08KcVWHDmlJpvbmqgCHO3oJI_M3j_aIHCiZ5CYJMWvB86VE9hkBf6Knf5bCHrwGXQLF11UiYXkq69Z2MQ Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:30.683943 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2bb24cc72064066b16a7321bbe0c1d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}] Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 2d80b3c2b07b4684a81e11d7e528fdc3 Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-398556454", "metadata": {"Type": "work"}}} Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:17:30.685277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-398556454', 'metadata': {'Type': 'work'}}}} Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise error Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi '0' Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:30.686226 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 14:17:30.687804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 14:17:30.688928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 11 14:17:30.688928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.688928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1a060e88-df5c-4be6-8d34-aba7c7f877f5 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:30.688928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1a060e88-df5c-4be6-8d34-aba7c7f877f5 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009030 Jul 11 14:17:30.688928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 509/1014] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 11 14:17:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 11 14:17:30.690206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:30.697408 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad260bc6-85df-463d-858b-c5d7bca2a772 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Action: 'create', calling method: .version_select at 0x7ffad50bb160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-562706174", "metadata": {"Type": "work"}}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad260bc6-85df-463d-858b-c5d7bca2a772 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Request method failure captured: Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 118 Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD6xpXq5tSsmqKtHSnUhEAJjeoVsm5xjFB46LDRE80gwvR0Sw-bv4DOPK-CIdMvDjJfBnyEgA-3CvFHEFBfd106VpBw5e08KcVWHDmlJpvbmqgCHO3oJI_M3j_aIHCiZ5CYJMWvB86VE9hkBf6Knf5bCHrwGXQLF11UiYXkq69Z2MQ Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:30.699805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2bb24cc72064066b16a7321bbe0c1d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}] Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 2d80b3c2b07b4684a81e11d7e528fdc3 Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-562706174", "metadata": {"Type": "work"}}} Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:17:30.701167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-562706174', 'metadata': {'Type': 'work'}}}} Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise error Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi '' Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:30.701965 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 11 14:17:30.703733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 11 14:17:30.706116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 11 14:17:30.706116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.706116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ad260bc6-85df-463d-858b-c5d7bca2a772 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:30.706116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ad260bc6-85df-463d-858b-c5d7bca2a772 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012363 Jul 11 14:17:30.706516 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 510/1015] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Jul 11 14:17:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 11 14:17:30.720929 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bf2635d3-5478-4851-8b22-b1cb93c51cbd tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Calling method '.version_select at 0x7ffad51895e0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:30.757071 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-bf2635d3-5478-4851-8b22-b1cb93c51cbd tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] HTTP exception thrown: Volume tempest-invalid-887698413 could not be found. Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bf2635d3-5478-4851-8b22-b1cb93c51cbd tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Request method failure captured: Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-887698413 HTTP/1.1 Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD6xpXq5tSsmqKtHSnUhEAJjeoVsm5xjFB46LDRE80gwvR0Sw-bv4DOPK-CIdMvDjJfBnyEgA-3CvFHEFBfd106VpBw5e08KcVWHDmlJpvbmqgCHO3oJI_M3j_aIHCiZ5CYJMWvB86VE9hkBf6Knf5bCHrwGXQLF11UiYXkq69Z2MQ Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:30.759242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2bb24cc72064066b16a7321bbe0c1d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}] Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 2d80b3c2b07b4684a81e11d7e528fdc3 Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Volume tempest-invalid-887698413 could not be found. Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'tempest-invalid-887698413'} Jul 11 14:17:30.760604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-887698413 could not be found. (HTTP 404) (Request-ID: req-663be03c-7a0a-4227-b93a-0fbf9d64494b) Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.761951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:17:30.763201 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-887698413 could not be found. Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:30.765153 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-887698413 could not be found. Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-887698413 could not be found. Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bf2635d3-5478-4851-8b22-b1cb93c51cbd tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Returning 404 to user: Volume tempest-invalid-887698413 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:30.767849 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bf2635d3-5478-4851-8b22-b1cb93c51cbd tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-887698413" status: 404 len: 98 microversion: 2.1 time: 0.050603 Jul 11 14:17:30.768841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:30.770446 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 511/1016] 10.222.0.49 () {58 vars in 1214 bytes} [Mon Jul 11 14:17:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-887698413 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 11 14:17:30.773524 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-93b44d3e-72d7-49a7-9516-499bb892cd54 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1273 microversion: 2.1 time: 0.112758 Jul 11 14:17:30.777904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 506/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:30 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:30.778700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f368dae5-30f1-4680-9ad1-6883c6bc0d66 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003786 Jul 11 14:17:30.778700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 512/1018] 10.222.0.49 () {58 vars in 1139 bytes} [Mon Jul 11 14:17:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 14:17:30.785503 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-27a604f8-1f73-442c-b101-5e136221210f tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004076 Jul 11 14:17:30.786003 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 507/1019] 10.222.0.49 () {58 vars in 1136 bytes} [Mon Jul 11 14:17:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 11 14:17:30.795784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-36e046c0-515e-461f-aa5e-f27d8e5f7256 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Calling method '.version_select at 0x7ffad509be50>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:30.826329 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-36e046c0-515e-461f-aa5e-f27d8e5f7256 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] HTTP exception thrown: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-36e046c0-515e-461f-aa5e-f27d8e5f7256 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Request method failure captured: Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/os-volumes/3465bae2-2f93-4a45-9bbc-41f9641285ff HTTP/1.1 Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD6xpXq5tSsmqKtHSnUhEAJjeoVsm5xjFB46LDRE80gwvR0Sw-bv4DOPK-CIdMvDjJfBnyEgA-3CvFHEFBfd106VpBw5e08KcVWHDmlJpvbmqgCHO3oJI_M3j_aIHCiZ5CYJMWvB86VE9hkBf6Knf5bCHrwGXQLF11UiYXkq69Z2MQ Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:30.828482 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2bb24cc72064066b16a7321bbe0c1d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}] Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 2d80b3c2b07b4684a81e11d7e528fdc3 Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '3465bae2-2f93-4a45-9bbc-41f9641285ff'} Jul 11 14:17:30.829843 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. (HTTP 404) (Request-ID: req-404903c8-22cc-4166-8062-b3e1d49e7908) Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.830734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 11 14:17:30.831988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 11 14:17:30.833671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-36e046c0-515e-461f-aa5e-f27d8e5f7256 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Returning 404 to user: Volume 3465bae2-2f93-4a45-9bbc-41f9641285ff could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-36e046c0-515e-461f-aa5e-f27d8e5f7256 tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/3465bae2-2f93-4a45-9bbc-41f9641285ff" status: 404 len: 109 microversion: 2.1 time: 0.038349 Jul 11 14:17:30.835590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 513/1020] 10.222.0.49 () {58 vars in 1247 bytes} [Mon Jul 11 14:17:30 2022] DELETE /compute/v2.1/os-volumes/3465bae2-2f93-4a45-9bbc-41f9641285ff => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:17:30.842787 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d4fbb5e5-1806-4df1-b5f1-85f6b439446e tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Calling method '.version_select at 0x7ffad5236dc0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:30.873237 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-d4fbb5e5-1806-4df1-b5f1-85f6b439446e tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] HTTP exception thrown: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d4fbb5e5-1806-4df1-b5f1-85f6b439446e tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Request method failure captured: Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/os-volumes/13130ca9-30c7-4c23-9a1a-2d908375746a HTTP/1.1 Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizDD6xpXq5tSsmqKtHSnUhEAJjeoVsm5xjFB46LDRE80gwvR0Sw-bv4DOPK-CIdMvDjJfBnyEgA-3CvFHEFBfd106VpBw5e08KcVWHDmlJpvbmqgCHO3oJI_M3j_aIHCiZ5CYJMWvB86VE9hkBf6Knf5bCHrwGXQLF11UiYXkq69Z2MQ Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:30.881648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e2bb24cc72064066b16a7321bbe0c1d4", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e2bb24cc72064066b16a7321bbe0c1d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e2bb24cc72064066b16a7321bbe0c1d4"}]}] Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: e2bb24cc72064066b16a7321bbe0c1d4 Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesNegativeTest-822981477 Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 2d80b3c2b07b4684a81e11d7e528fdc3 Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesNegativeTest-822981477-project Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '13130ca9-30c7-4c23-9a1a-2d908375746a'} Jul 11 14:17:30.883144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. (HTTP 404) (Request-ID: req-046837a7-3b72-43ee-98a8-b129a7017634) Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.883942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 11 14:17:30.885164 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 11 14:17:30.886599 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d4fbb5e5-1806-4df1-b5f1-85f6b439446e tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] Returning 404 to user: Volume 13130ca9-30c7-4c23-9a1a-2d908375746a could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d4fbb5e5-1806-4df1-b5f1-85f6b439446e tempest-VolumesNegativeTest-822981477 tempest-VolumesNegativeTest-822981477-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/13130ca9-30c7-4c23-9a1a-2d908375746a" status: 404 len: 109 microversion: 2.1 time: 0.047864 Jul 11 14:17:30.888958 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 508/1021] 10.222.0.49 () {58 vars in 1244 bytes} [Mon Jul 11 14:17:30 2022] GET /compute/v2.1/os-volumes/13130ca9-30c7-4c23-9a1a-2d908375746a => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:17:31.792858 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:31.794043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:31.801600 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.802042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.803016 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:31.803607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:31.949857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:31.959336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-03120844-209f-4a31-b41e-f60f9b7000b0 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.171414 Jul 11 14:17:31.959906 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 514/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:31 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:32.408843 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8380dc4a-b792-46b5-9118-3a785a1833ce req-3b232710-bf86-40ba-9a6e-0270334b333a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eceb262c-e622-4e09-9050-ae977ae9ae89", "tag": "f5db50f9-f3ff-402d-967f-b9e5a25bbccf"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:32.420274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8380dc4a-b792-46b5-9118-3a785a1833ce req-3b232710-bf86-40ba-9a6e-0270334b333a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:32.420739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8380dc4a-b792-46b5-9118-3a785a1833ce req-3b232710-bf86-40ba-9a6e-0270334b333a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:32.432607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8380dc4a-b792-46b5-9118-3a785a1833ce req-3b232710-bf86-40ba-9a6e-0270334b333a service nova] Creating event network-changed:f5db50f9-f3ff-402d-967f-b9e5a25bbccf for instance eceb262c-e622-4e09-9050-ae977ae9ae89 on hv-cinder-84842 Jul 11 14:17:32.439438 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8380dc4a-b792-46b5-9118-3a785a1833ce req-3b232710-bf86-40ba-9a6e-0270334b333a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037382 Jul 11 14:17:32.440287 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 509/1023] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:32.976350 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:32.976969 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:32.983860 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:32.984356 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:32.985131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:32.985569 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:33.120491 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:33.131402 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-cb32d680-7a28-412d-8eb1-fb5381e7b006 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.158792 Jul 11 14:17:33.132746 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 515/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:32 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:34.149140 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:34.149865 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:34.156626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:34.157010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:34.157766 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:34.158201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:34.287721 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:34.295348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d60891fd-21b3-467b-b3ea-63165303b3a7 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.150442 Jul 11 14:17:34.295914 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 510/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:34 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:35.313645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:35.314216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:35.321537 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:35.321988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:35.322797 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:35.323235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:35.470423 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:35.478728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-04873b77-ec28-4cc4-bd97-ddb7caaa333a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.168944 Jul 11 14:17:35.479323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 516/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:35 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:36.495491 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:36.496106 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:36.503524 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:36.503978 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:36.505152 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:36.505595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:36.646637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:36.654662 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0196c863-16bc-4519-8441-e3c0dac44e4f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.162980 Jul 11 14:17:36.663858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 511/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:36 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:37.671405 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:37.672083 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:37.674532 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:37.680228 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:37.680680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:37.681460 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:37.681905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:37.819832 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:37.827293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-aeb0f3d5-80b5-4a78-84dd-2eae311f8782 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.159743 Jul 11 14:17:37.827778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 517/1028] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:37 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:38.625828 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-be0b569f-6b6a-4637-9067-92f140303570 req-7244a0c3-f0b5-418f-8f3a-3187d6ba4d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceb262c-e622-4e09-9050-ae977ae9ae89", "name": "network-vif-plugged", "status": "completed", "tag": "f5db50f9-f3ff-402d-967f-b9e5a25bbccf"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:38.633494 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:38.636612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-be0b569f-6b6a-4637-9067-92f140303570 req-7244a0c3-f0b5-418f-8f3a-3187d6ba4d25 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:38.637061 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-be0b569f-6b6a-4637-9067-92f140303570 req-7244a0c3-f0b5-418f-8f3a-3187d6ba4d25 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:38.649703 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-be0b569f-6b6a-4637-9067-92f140303570 req-7244a0c3-f0b5-418f-8f3a-3187d6ba4d25 service nova] Creating event network-vif-plugged:f5db50f9-f3ff-402d-967f-b9e5a25bbccf for instance eceb262c-e622-4e09-9050-ae977ae9ae89 on hv-cinder-84842 Jul 11 14:17:38.654866 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-be0b569f-6b6a-4637-9067-92f140303570 req-7244a0c3-f0b5-418f-8f3a-3187d6ba4d25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Jul 11 14:17:38.655598 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 512/1029] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:38.844236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:38.845917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:38.853025 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:38.853512 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:38.854323 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:38.854766 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:38.990336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:38.997613 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-6c0e5b90-14ba-4d85-92cc-266b6af37d60 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.157587 Jul 11 14:17:38.998182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 518/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:38 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:40.012546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:40.017045 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:40.017813 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:40.025319 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:40.025779 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:40.026580 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:40.027020 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:40.176017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:40.185704 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-74717175-4f45-4e78-9bb1-a1bcc660944d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1313 microversion: 2.1 time: 0.174517 Jul 11 14:17:40.186398 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 513/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:40 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:41.202116 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:41.202842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:41.204672 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:41.205334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:41.212887 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:41.213340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:41.214189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:41.214565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:41.352920 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:41.360438 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8a21fcfc-e284-4a80-a6f8-fa0df5a4c5f2 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1497 microversion: 2.1 time: 0.162098 Jul 11 14:17:41.361008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 519/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:41 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:41.868554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:41.869151 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:41.877124 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:41.878925 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:41.880060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:41.880878 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:41.909351 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:17:42.000852 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c44c1b16-882a-4d75-ab07-149d8ec4e623 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "DELETE /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 204 len: 0 microversion: 2.1 time: 0.137094 Jul 11 14:17:42.001679 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 514/1033] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:17:41 2022] DELETE /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 11 14:17:42.010440 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:42.011189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:42.017992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:42.019282 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:42.019439 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:42.019744 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:42.157682 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:42.165181 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5d7655fb-8fed-4393-8f7f-05d3017c62ed tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1503 microversion: 2.1 time: 0.159359 Jul 11 14:17:42.165751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 520/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:42 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:43.186622 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:43.187714 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:43.195197 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:43.195644 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:43.199234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:43.199673 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:43.336841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:43.344487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-86d2d027-fc18-4a09-8dc9-8a4e4a5a5003 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1503 microversion: 2.1 time: 0.164964 Jul 11 14:17:43.345070 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 515/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:43 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:44.361404 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:44.362764 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:44.371194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:44.371910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:44.372902 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:44.373568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:44.470742 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:44.492745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a0e3b3e8-b9c3-4244-86e3-fc579b1a925a tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 200 len: 1461 microversion: 2.1 time: 0.135089 Jul 11 14:17:44.493463 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 521/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:44 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 1461 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:44.680888 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-21cccb95-90b6-46da-b9e9-1b098e9154d6 req-74d0bb0e-93c0-4f6d-9f8a-035da471089b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceb262c-e622-4e09-9050-ae977ae9ae89", "name": "network-vif-deleted", "tag": "f5db50f9-f3ff-402d-967f-b9e5a25bbccf"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:44.688832 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-21cccb95-90b6-46da-b9e9-1b098e9154d6 req-74d0bb0e-93c0-4f6d-9f8a-035da471089b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:44.689264 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-21cccb95-90b6-46da-b9e9-1b098e9154d6 req-74d0bb0e-93c0-4f6d-9f8a-035da471089b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:44.700448 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-21cccb95-90b6-46da-b9e9-1b098e9154d6 req-74d0bb0e-93c0-4f6d-9f8a-035da471089b service nova] Creating event network-vif-deleted:f5db50f9-f3ff-402d-967f-b9e5a25bbccf for instance eceb262c-e622-4e09-9050-ae977ae9ae89 on hv-cinder-84842 Jul 11 14:17:44.705225 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-21cccb95-90b6-46da-b9e9-1b098e9154d6 req-74d0bb0e-93c0-4f6d-9f8a-035da471089b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250051 Jul 11 14:17:44.705819 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 516/1037] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:17:45.510096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:45.510926 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: eceb262c-e622-4e09-9050-ae977ae9ae89] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:45.518602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:45.519240 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:45.520094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:45.520612 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:45.536039 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] HTTP exception thrown: Instance eceb262c-e622-4e09-9050-ae977ae9ae89 could not be found. Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Request method failure captured: Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 HTTP/1.1 Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD3e2us8wJsJ8lmCcgAcMyCUbbsldlk2b65mzuKeLXZgrZX1hWuY-czBnAdVy_Kvwxtjy3EcbsWZYPV1txMz-OK9rU9bIUN-ZEVouDdPiWMOrO5VihrmYpbspLxOr0nO8Nzu6qSfO4w5w4Mixey-Q161MBMNoBpWtWWMLvtKsXIXic Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 9a7d950a8bf049dcb5600fc64b3b6cc0 Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesActionsTest-74688326 Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:45.537581 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a7d950a8bf049dcb5600fc64b3b6cc0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a7d950a8bf049dcb5600fc64b3b6cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a7d950a8bf049dcb5600fc64b3b6cc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a7d950a8bf049dcb5600fc64b3b6cc0"}]}] Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesActionsTest-74688326 Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 9a7d950a8bf049dcb5600fc64b3b6cc0 Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesActionsTest-74688326 Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesActionsTest-74688326-project Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 9ae9e78d25e94319801ce906327ada27 Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesActionsTest-74688326-project Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance eceb262c-e622-4e09-9050-ae977ae9ae89 could not be found. Jul 11 14:17:45.539386 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'eceb262c-e622-4e09-9050-ae977ae9ae89'} Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eceb262c-e622-4e09-9050-ae977ae9ae89 could not be found. Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:45.540334 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eceb262c-e622-4e09-9050-ae977ae9ae89 could not be found. Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eceb262c-e622-4e09-9050-ae977ae9ae89 could not be found. Jul 11 14:17:45.541883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:45.543236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Returning 404 to user: Instance eceb262c-e622-4e09-9050-ae977ae9ae89 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:45.543236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f53cdd8f-d6ba-4387-a999-60baea7d36d4 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89" status: 404 len: 111 microversion: 2.1 time: 0.033393 Jul 11 14:17:45.543236 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 522/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:45 2022] GET /compute/v2.1/servers/eceb262c-e622-4e09-9050-ae977ae9ae89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 11 14:17:45.648840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2060802365", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "networks": [{"uuid": "2732531a-d3b6-48a8-b1d1-0ab620f2a389"}]}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:45.703527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] validate_networks() for [('2732531a-d3b6-48a8-b1d1-0ab620f2a389', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:17:46.201277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:17:46.201706 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:17:46.202178 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:17:46.202626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:17:46.203040 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:17:46.211927 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:46.212378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:46.213176 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:46.213612 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:46.232296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Getting quotas for project 9a7d950a8bf049dcb5600fc64b3b6cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:17:46.236571 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Getting quotas for user 9ae9e78d25e94319801ce906327ada27 and project 9a7d950a8bf049dcb5600fc64b3b6cc0. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:17:46.250464 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:17:46.252822 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:17:46.299103 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5d7197b7-4562-4ae2-aeaf-8d08b7948c34 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655327 Jul 11 14:17:46.300007 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 517/1039] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:17:46.310888 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4339e436-a50b-4d4c-bc49-1002d9a2091e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:46.311890 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4339e436-a50b-4d4c-bc49-1002d9a2091e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:46.374264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-4339e436-a50b-4d4c-bc49-1002d9a2091e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:46.381558 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4339e436-a50b-4d4c-bc49-1002d9a2091e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1214 microversion: 2.1 time: 0.075307 Jul 11 14:17:46.382507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 523/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:46 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:47.400272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:47.400890 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:47.407323 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:47.407778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:47.408544 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:47.408982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:47.411798 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:47.482641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:47.490643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-25c14eda-5ef0-4316-a992-633509aeb109 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1266 microversion: 2.1 time: 0.095312 Jul 11 14:17:47.495778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 518/1041] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:47 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:47.854197 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:47.855397 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:47.862751 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:47.863199 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:47.863970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:47.864410 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:47.868635 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=80 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:47.897243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c5218103-f80a-4e59-a096-68156b9549e5 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047065 Jul 11 14:17:47.897879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 524/1042] 10.222.0.49 () {60 vars in 1342 bytes} [Mon Jul 11 14:17:47 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:47.984332 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:47.985215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:47.996206 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:47.997027 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:47.998367 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:47.999172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:48.027775 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:17:48.113121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-826a741d-a644-4610-8722-f1a86f9df6af tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 204 len: 0 microversion: 2.20 time: 0.135646 Jul 11 14:17:48.113729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 519/1043] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 11 14:17:47 2022] DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:17:48.122910 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:48.123527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:48.133465 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:48.133905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:48.135037 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:48.135190 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:48.292413 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:48.300717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:48.302220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:48.303414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e94167b8-093a-437f-94f4-4cf8664e5900 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.184718 Jul 11 14:17:48.303984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 525/1044] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:48 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:17:48.509443 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:48.510285 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:48.519317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:48.519802 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:48.520780 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:48.521226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:48.663349 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:48.671667 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-198059df-476a-462e-a44b-339f7b05113c tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.166506 Jul 11 14:17:48.672208 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 520/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:48 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:49.324258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:49.324809 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:49.331497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:49.331947 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:49.332722 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:49.333159 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:49.481840 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:49.492224 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:49.493761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:49.495207 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ae447edd-731f-4fef-b1e7-682953a0d979 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.175584 Jul 11 14:17:49.495769 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 526/1046] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:49 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:17:49.689961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:49.690629 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:49.697982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:49.698587 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:49.699436 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:49.699887 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:49.842376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:49.851042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-33566641-9032-43e8-9d01-f7700db67dbf tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.165676 Jul 11 14:17:49.852851 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 521/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:49 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:50.254387 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-d578681f-7107-4346-b5fa-34b666340edb req-b8321cb3-fe37-41c8-a8e8-1fb7c21fcb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46a8091-1dae-4ce3-99c1-ed002b991e84", "tag": "92e64234-8aa5-4470-bb21-e82acf1e228b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:50.268069 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-d578681f-7107-4346-b5fa-34b666340edb req-b8321cb3-fe37-41c8-a8e8-1fb7c21fcb73 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:50.268733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-d578681f-7107-4346-b5fa-34b666340edb req-b8321cb3-fe37-41c8-a8e8-1fb7c21fcb73 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:50.281340 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-d578681f-7107-4346-b5fa-34b666340edb req-b8321cb3-fe37-41c8-a8e8-1fb7c21fcb73 service nova] Creating event network-changed:92e64234-8aa5-4470-bb21-e82acf1e228b for instance e46a8091-1dae-4ce3-99c1-ed002b991e84 on hv-cinder-84842 Jul 11 14:17:50.286394 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-d578681f-7107-4346-b5fa-34b666340edb req-b8321cb3-fe37-41c8-a8e8-1fb7c21fcb73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035671 Jul 11 14:17:50.287535 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 527/1048] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:50.514060 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:50.514861 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:50.521606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:50.522058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:50.522875 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:50.523961 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:50.657953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:50.666364 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:50.667864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:50.669013 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-3429f3e0-5c17-4b7a-a689-184f8f5d74e8 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1724 microversion: 2.20 time: 0.158956 Jul 11 14:17:50.680370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 522/1049] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:50 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:17:50.870958 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:50.871934 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:50.879548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:50.880208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:50.881435 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:50.882111 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:51.035262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:51.043155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-dab3aa22-8a1c-4da3-83d7-a51061ea8bf5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.176999 Jul 11 14:17:51.043961 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 528/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:50 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:51.688239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:51.688786 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:51.695447 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:51.695953 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:51.696841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:51.697493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:51.775025 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:51.783039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:51.784547 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:51.785707 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7276b7db-ba24-4458-85e9-bc49cf32923b tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1657 microversion: 2.20 time: 0.101412 Jul 11 14:17:51.786266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 523/1051] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:51 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1657 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:17:52.062991 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:52.063927 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:52.071301 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:52.071952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:52.072897 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:52.073557 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:52.216717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:52.225285 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9350b8a8-bf3a-434d-8e38-f8c860c17370 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.166957 Jul 11 14:17:52.226896 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 529/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:52 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:17:52.309682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-9c4d5cdc-ec9e-4d61-8195-17e031cf31fb req-dcc66252-44c3-42fc-93a7-d25124c1e9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5636c141-0ab2-42c5-ae0d-dedad7a1ac5f", "name": "network-vif-deleted", "tag": "324eb4e8-e871-4b27-ae51-8c78d7f0ec4e"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:52.317726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-9c4d5cdc-ec9e-4d61-8195-17e031cf31fb req-dcc66252-44c3-42fc-93a7-d25124c1e9bc service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:52.318172 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-9c4d5cdc-ec9e-4d61-8195-17e031cf31fb req-dcc66252-44c3-42fc-93a7-d25124c1e9bc service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:52.332669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-9c4d5cdc-ec9e-4d61-8195-17e031cf31fb req-dcc66252-44c3-42fc-93a7-d25124c1e9bc service nova] Creating event network-vif-deleted:324eb4e8-e871-4b27-ae51-8c78d7f0ec4e for instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f on hv-cinder-84842 Jul 11 14:17:52.340651 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-9c4d5cdc-ec9e-4d61-8195-17e031cf31fb req-dcc66252-44c3-42fc-93a7-d25124c1e9bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Jul 11 14:17:52.341431 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 524/1053] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:53.024174 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:53.024844 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:53.031280 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:53.031725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:53.032485 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:53.032967 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:53.100705 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:53.109106 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:53.110650 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98143abd2e3c47e3921184a1c5e05a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beef80716d254a03a5e673b9cfd781ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:53.111803 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9b1048a8-c889-4a1f-a29a-87d11de26541 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 200 len: 1657 microversion: 2.20 time: 0.312065 Jul 11 14:17:53.112364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 530/1054] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:52 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 1657 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 11 14:17:53.244092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:53.244877 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:53.251876 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:53.252416 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:53.253266 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:53.253795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:53.423966 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:53.434946 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-893f30ea-7e45-41fd-8a96-eeda0204907e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.195642 Jul 11 14:17:53.438343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 525/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:53 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:54.129239 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:54.129780 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:54.136380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:54.136833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:54.137597 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:54.138035 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:54.151886 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] HTTP exception thrown: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Request method failure captured: Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f HTTP/1.1 Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6Lj5Bq_7SXFNnnMs4rgxiHxac0pFz7E0VgjQo7DNjvb58_PKVe89iwIbZ4xkdGiARqj3e-EBd5iT_qFrs6LbJcsushIy6VGrbOcNEZFKayCpBXhKeEbsDhwlDrJGsVb88ifjijTNS0e1gFWvWdRLyGd1jvD7qt1jswjGRR3koAkQo Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:54.153542 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_beef80716d254a03a5e673b9cfd781ce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}] Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 98143abd2e3c47e3921184a1c5e05a89 Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:54.155264 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '5636c141-0ab2-42c5-ae0d-dedad7a1ac5f'} Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:54.156266 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:54.157725 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:54.159254 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Returning 404 to user: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:54.159254 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2708d902-48ab-45a6-b1d1-d0312e2bc909 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 404 len: 111 microversion: 2.20 time: 0.029804 Jul 11 14:17:54.159254 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 531/1056] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:54 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 11 14:17:54.164738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-49db118a-3798-4566-9292-6b8b43f67f8e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '.version_select at 0x7ffad51c35e0>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:54.184901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-49db118a-3798-4566-9292-6b8b43f67f8e tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125289354" status: 204 len: 0 microversion: 2.20 time: 0.024540 Jul 11 14:17:54.185773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 526/1057] 10.222.0.49 () {60 vars in 1261 bytes} [Mon Jul 11 14:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125289354 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 11 14:17:54.452308 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:54.452945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:54.459281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:54.459724 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:54.461108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:54.461538 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:54.603359 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:54.611641 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1e5b0d1a-bef8-45b8-9072-2fdcc17048a1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.163306 Jul 11 14:17:54.614336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 532/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:54 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:55.630637 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:55.631236 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:55.638555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:55.639006 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:55.639779 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:55.640220 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:56.031258 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:56.039608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d825867f-bbe2-40a3-962c-0ff39c255e81 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.412872 Jul 11 14:17:56.040240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 527/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:55 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:56.263871 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:56.264380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:56.270525 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:56.270979 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:56.271759 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:56.272182 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:56.285604 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] HTTP exception thrown: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Request method failure captured: Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f HTTP/1.1 Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6Lj5Bq_7SXFNnnMs4rgxiHxac0pFz7E0VgjQo7DNjvb58_PKVe89iwIbZ4xkdGiARqj3e-EBd5iT_qFrs6LbJcsushIy6VGrbOcNEZFKayCpBXhKeEbsDhwlDrJGsVb88ifjijTNS0e1gFWvWdRLyGd1jvD7qt1jswjGRR3koAkQo Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:56.287090 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_beef80716d254a03a5e673b9cfd781ce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}] Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 98143abd2e3c47e3921184a1c5e05a89 Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.289332 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '5636c141-0ab2-42c5-ae0d-dedad7a1ac5f'} Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:56.290185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.291551 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.292819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Returning 404 to user: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:56.292819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0eb4a9e7-5bd0-4fee-8762-55e79446d827 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 404 len: 111 microversion: 2.20 time: 0.028615 Jul 11 14:17:56.292819 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 533/1060] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 11 14:17:56 2022] DELETE /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:17:56.297648 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:56.298258 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:56.300488 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:56.301166 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:56.307301 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:56.307750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:56.308507 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:56.308943 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:56.322562 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] HTTP exception thrown: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Request method failure captured: Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f HTTP/1.1 Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Lj5Bq_7SXFNnnMs4rgxiHxac0pFz7E0VgjQo7DNjvb58_PKVe89iwIbZ4xkdGiARqj3e-EBd5iT_qFrs6LbJcsushIy6VGrbOcNEZFKayCpBXhKeEbsDhwlDrJGsVb88ifjijTNS0e1gFWvWdRLyGd1jvD7qt1jswjGRR3koAkQo Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:56.324254 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_beef80716d254a03a5e673b9cfd781ce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}] Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 98143abd2e3c47e3921184a1c5e05a89 Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.325919 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '5636c141-0ab2-42c5-ae0d-dedad7a1ac5f'} Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:56.327064 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. Jul 11 14:17:56.328274 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:56.329583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Returning 404 to user: Instance 5636c141-0ab2-42c5-ae0d-dedad7a1ac5f could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:56.329583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6e3806f0-87ae-4bdd-9262-aea9a26d94db tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f" status: 404 len: 111 microversion: 2.20 time: 0.031904 Jul 11 14:17:56.329583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 528/1061] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:56 2022] GET /compute/v2.1/servers/5636c141-0ab2-42c5-ae0d-dedad7a1ac5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:17:56.695341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:56.761818 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-82210fc2-ad81-467c-b2fd-5d6963ae0713 req-f0a8c3d9-28a9-4310-a4b3-6d049824eec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46a8091-1dae-4ce3-99c1-ed002b991e84", "name": "network-vif-plugged", "status": "completed", "tag": "92e64234-8aa5-4470-bb21-e82acf1e228b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:17:56.772028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-82210fc2-ad81-467c-b2fd-5d6963ae0713 req-f0a8c3d9-28a9-4310-a4b3-6d049824eec9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:56.772297 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-82210fc2-ad81-467c-b2fd-5d6963ae0713 req-f0a8c3d9-28a9-4310-a4b3-6d049824eec9 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:56.788521 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-82210fc2-ad81-467c-b2fd-5d6963ae0713 req-f0a8c3d9-28a9-4310-a4b3-6d049824eec9 service nova] Creating event network-vif-plugged:92e64234-8aa5-4470-bb21-e82acf1e228b for instance e46a8091-1dae-4ce3-99c1-ed002b991e84 on hv-cinder-84842 Jul 11 14:17:56.793802 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-82210fc2-ad81-467c-b2fd-5d6963ae0713 req-f0a8c3d9-28a9-4310-a4b3-6d049824eec9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104275 Jul 11 14:17:56.795044 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 534/1062] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:17:57.057719 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:57.058520 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:57.064494 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.065109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.065874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.066326 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.205499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:57.213782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2c6e48db-c772-4b52-9a89-16f63fc5e3bb tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.160898 Jul 11 14:17:57.214664 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 529/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:57 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:57.462633 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:57.463216 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:57.471281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.471732 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.472509 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.472945 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.486993 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] HTTP exception thrown: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Request method failure captured: Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d HTTP/1.1 Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizC6Lj5Bq_7SXFNnnMs4rgxiHxac0pFz7E0VgjQo7DNjvb58_PKVe89iwIbZ4xkdGiARqj3e-EBd5iT_qFrs6LbJcsushIy6VGrbOcNEZFKayCpBXhKeEbsDhwlDrJGsVb88ifjijTNS0e1gFWvWdRLyGd1jvD7qt1jswjGRR3koAkQo Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:17:57.488706 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_beef80716d254a03a5e673b9cfd781ce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}] Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 98143abd2e3c47e3921184a1c5e05a89 Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.490352 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '4b6b4651-c65b-40b8-bcf6-e27e6274ef5d'} Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:57.494565 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.495975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.497383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Returning 404 to user: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:57.497383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2271e8e2-2fcf-48ae-9c40-f870f0c7a10d tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 404 len: 111 microversion: 2.20 time: 0.032358 Jul 11 14:17:57.497383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 535/1064] 10.222.0.49 () {60 vars in 1279 bytes} [Mon Jul 11 14:17:57 2022] DELETE /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 11 14:17:57.499105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:57.499738 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] [instance: 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:57.505849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.506509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.507718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:57.508234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:57.521990 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] HTTP exception thrown: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Request method failure captured: Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d HTTP/1.1 Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizC6Lj5Bq_7SXFNnnMs4rgxiHxac0pFz7E0VgjQo7DNjvb58_PKVe89iwIbZ4xkdGiARqj3e-EBd5iT_qFrs6LbJcsushIy6VGrbOcNEZFKayCpBXhKeEbsDhwlDrJGsVb88ifjijTNS0e1gFWvWdRLyGd1jvD7qt1jswjGRR3koAkQo Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Openstack-Nova-Api-Version: 2.20 Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:17:57.524202 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_beef80716d254a03a5e673b9cfd781ce", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/beef80716d254a03a5e673b9cfd781ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/beef80716d254a03a5e673b9cfd781ce"}]}] Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: beef80716d254a03a5e673b9cfd781ce Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1017298285 Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 98143abd2e3c47e3921184a1c5e05a89 Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1017298285-project Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.525930 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '4b6b4651-c65b-40b8-bcf6-e27e6274ef5d'} Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:17:57.527365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. Jul 11 14:17:57.528940 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:17:57.530295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] Returning 404 to user: Instance 4b6b4651-c65b-40b8-bcf6-e27e6274ef5d could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:17:57.530295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-a1aad314-5772-4ab8-adc2-46ba09435851 tempest-AttachVolumeShelveTestJSON-1017298285 tempest-AttachVolumeShelveTestJSON-1017298285-project] 10.222.0.49 "GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d" status: 404 len: 111 microversion: 2.20 time: 0.030785 Jul 11 14:17:57.530295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 530/1065] 10.222.0.49 () {60 vars in 1276 bytes} [Mon Jul 11 14:17:57 2022] GET /compute/v2.1/servers/4b6b4651-c65b-40b8-bcf6-e27e6274ef5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 11 14:17:58.230664 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:58.231688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:58.239120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:58.240092 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:58.240863 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:58.241291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:58.468329 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:58.477255 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-63fbc9d9-aa96-44b5-a3b2-ad95932041b5 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1314 microversion: 2.1 time: 0.250450 Jul 11 14:17:58.478108 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 536/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:58 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:17:59.495813 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:17:59.496493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:17:59.503187 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:59.503639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:59.504442 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:17:59.504983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:17:59.643083 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:17:59.651015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1b333729-8695-478c-ab11-7a3e51c8c250 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1497 microversion: 2.1 time: 0.159713 Jul 11 14:17:59.651585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 531/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:17:59 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:18:04.632738 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:04.633788 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:04.641167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.641621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.642539 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.644101 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.671378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:18:04.767147 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8cf891bb-9803-434a-818f-c77a2f0bdd2d tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 204 len: 0 microversion: 2.1 time: 0.138601 Jul 11 14:18:04.769162 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 537/1068] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:18:04 2022] DELETE /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:18:04.777393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:04.778156 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:04.785697 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.786146 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.786993 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:04.787417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:04.943669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:04.952418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-bb4eed96-58b1-48e6-bcf7-6121055a7e75 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1503 microversion: 2.1 time: 0.178806 Jul 11 14:18:04.953002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 532/1069] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:04 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:05.974679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:05.975510 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:05.982427 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:05.982877 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:05.983679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:05.984112 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:06.116135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:06.126326 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-03c0dde1-cc76-4058-86cc-8f705547e328 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1503 microversion: 2.1 time: 0.155882 Jul 11 14:18:06.127274 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 538/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:05 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:07.145275 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:07.145894 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:07.152945 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:07.153407 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:07.154185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:07.154660 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:07.290226 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:07.298585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8d6b92f5-3d0f-439b-a063-e17cfa21453b tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1503 microversion: 2.1 time: 0.157140 Jul 11 14:18:07.299378 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 533/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:07 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:08.315675 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:08.316283 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:08.318809 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:08.324908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:08.325467 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:08.326398 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:08.326677 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:08.460727 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:08.468487 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bfe8c620-5506-4b73-a83a-9ade40f760b9 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1503 microversion: 2.1 time: 0.156529 Jul 11 14:18:08.469540 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 539/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:08 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:09.486098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:09.486762 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:09.493864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:09.494328 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:09.495111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:09.495549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:09.628792 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:09.638682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-aca4d46c-2c14-4d66-9acd-42bfdab1becd tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1503 microversion: 2.1 time: 0.155004 Jul 11 14:18:09.638682 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 534/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:09 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:10.655835 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:10.656547 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:10.663621 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:10.664517 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:10.665357 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:10.665879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:10.749133 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-31482a79-1721-4250-8727-324bd6072dd3 req-2d3159dd-2256-4e83-9e5a-9c99d63269c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46a8091-1dae-4ce3-99c1-ed002b991e84", "name": "network-vif-deleted", "tag": "92e64234-8aa5-4470-bb21-e82acf1e228b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:10.753341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:10.759306 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-31482a79-1721-4250-8727-324bd6072dd3 req-2d3159dd-2256-4e83-9e5a-9c99d63269c5 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:10.760354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-31482a79-1721-4250-8727-324bd6072dd3 req-2d3159dd-2256-4e83-9e5a-9c99d63269c5 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:10.772510 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-31482a79-1721-4250-8727-324bd6072dd3 req-2d3159dd-2256-4e83-9e5a-9c99d63269c5 service nova] Creating event network-vif-deleted:92e64234-8aa5-4470-bb21-e82acf1e228b for instance e46a8091-1dae-4ce3-99c1-ed002b991e84 on hv-cinder-84842 Jul 11 14:18:10.777856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-31482a79-1721-4250-8727-324bd6072dd3 req-2d3159dd-2256-4e83-9e5a-9c99d63269c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037415 Jul 11 14:18:10.778885 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 535/1074] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:10.783281 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:10.791464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5e11a405-9df2-4fba-9ef5-0d89c8862dbc tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1461 microversion: 2.1 time: 0.140433 Jul 11 14:18:10.792042 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 540/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:10 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1461 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:11.809330 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:11.810030 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:11.817199 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:11.817650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:11.818646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:11.819081 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:11.851618 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:11.852062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:11.852511 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lazy-loading 'fault' on Instance uuid e46a8091-1dae-4ce3-99c1-ed002b991e84 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:11.855403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:11.897836 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:11.906242 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b8def30b-70e2-4f47-b3ac-d1eff8201281 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1304 microversion: 2.1 time: 0.101517 Jul 11 14:18:11.906870 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 536/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:11 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:12.923512 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:12.924122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:12.931489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:12.931937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:12.932701 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:12.933140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:12.966043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:12.966540 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:12.966999 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.objects.instance [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lazy-loading 'fault' on Instance uuid e46a8091-1dae-4ce3-99c1-ed002b991e84 {{(pid=117981) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:13.008233 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:13.016336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bd24acd1-e2b9-487c-9e4b-86eca3b75c9f tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1304 microversion: 2.1 time: 0.096657 Jul 11 14:18:13.016905 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 541/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:12 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:14.033041 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:14.033563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:14.040015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:14.040457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:14.041211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:14.041643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:14.073444 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:14.073897 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:14.074369 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lazy-loading 'fault' on Instance uuid e46a8091-1dae-4ce3-99c1-ed002b991e84 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:18:14.114960 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ae9e78d25e94319801ce906327ada27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7d950a8bf049dcb5600fc64b3b6cc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:14.122995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-202ca791-4e27-416e-8000-601d2e37eaa1 tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 200 len: 1304 microversion: 2.1 time: 0.093876 Jul 11 14:18:14.123560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 537/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:14 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:15.140666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:15.141349 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] [instance: e46a8091-1dae-4ce3-99c1-ed002b991e84] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:15.149269 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:15.149728 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:15.150548 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:15.150989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:15.156605 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:15.170927 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] HTTP exception thrown: Instance e46a8091-1dae-4ce3-99c1-ed002b991e84 could not be found. Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Request method failure captured: Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 HTTP/1.1 Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDD3e2us8wJsJ8lmCcgAcMyCUbbsldlk2b65mzuKeLXZgrZX1hWuY-czBnAdVy_Kvwxtjy3EcbsWZYPV1txMz-OK9rU9bIUN-ZEVouDdPiWMOrO5VihrmYpbspLxOr0nO8Nzu6qSfO4w5w4Mixey-Q161MBMNoBpWtWWMLvtKsXIXic Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 9a7d950a8bf049dcb5600fc64b3b6cc0 Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-VolumesActionsTest-74688326 Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:18:15.173011 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a7d950a8bf049dcb5600fc64b3b6cc0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a7d950a8bf049dcb5600fc64b3b6cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a7d950a8bf049dcb5600fc64b3b6cc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a7d950a8bf049dcb5600fc64b3b6cc0"}]}] Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-VolumesActionsTest-74688326 Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 9a7d950a8bf049dcb5600fc64b3b6cc0 Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-VolumesActionsTest-74688326 Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-VolumesActionsTest-74688326-project Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 9ae9e78d25e94319801ce906327ada27 Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-VolumesActionsTest-74688326-project Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance e46a8091-1dae-4ce3-99c1-ed002b991e84 could not be found. Jul 11 14:18:15.174596 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': 'e46a8091-1dae-4ce3-99c1-ed002b991e84'} Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46a8091-1dae-4ce3-99c1-ed002b991e84 could not be found. Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:18:15.175632 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46a8091-1dae-4ce3-99c1-ed002b991e84 could not be found. Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46a8091-1dae-4ce3-99c1-ed002b991e84 could not be found. Jul 11 14:18:15.177145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:18:15.179231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] Returning 404 to user: Instance e46a8091-1dae-4ce3-99c1-ed002b991e84 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:18:15.179231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3f62ef5b-2649-4876-8092-478b4182739e tempest-VolumesActionsTest-74688326 tempest-VolumesActionsTest-74688326-project] 10.222.0.49 "GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84" status: 404 len: 111 microversion: 2.1 time: 0.037801 Jul 11 14:18:15.179231 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 542/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:15 2022] GET /compute/v2.1/servers/e46a8091-1dae-4ce3-99c1-ed002b991e84 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:18:42.541089 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:18:42.541782 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:18:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:18:54.331347 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1450998293", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "networks": [{"uuid": "9042c877-52fd-4c28-9ce3-19f99d46d913"}]}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:54.338418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=9 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:54.339078 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=11 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:54.389794 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] validate_networks() for [('9042c877-52fd-4c28-9ce3-19f99d46d913', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:18:54.761778 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:18:54.762257 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:18:54.762760 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:18:54.763175 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:18:54.763622 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:18:54.775782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:54.776209 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:54.776998 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:54.777428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:54.796523 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Getting quotas for project 58346265e4c244dcb15cd6ec2817773a. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:18:54.801052 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Getting quotas for user 72a0be934143483e8cdcc25fb7b3c915 and project 58346265e4c244dcb15cd6ec2817773a. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:18:54.812572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:18:54.814853 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:18:54.864904 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-49970992-80fb-48ab-973a-ac0dd608836e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537462 Jul 11 14:18:54.865583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 538/1080] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:18:54.876821 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-495cc374-e71e-4363-be8d-a671a860a89a tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:54.877704 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-495cc374-e71e-4363-be8d-a671a860a89a tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:54.880308 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=9 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:54.947908 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-495cc374-e71e-4363-be8d-a671a860a89a tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:54.957420 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-495cc374-e71e-4363-be8d-a671a860a89a tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1219 microversion: 2.1 time: 0.084305 Jul 11 14:18:54.958291 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 543/1081] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:54 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:55.974562 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:55.975114 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:55.981497 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:55.981939 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:55.982724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:55.983160 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:56.051631 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:56.061789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-1577ef67-b291-4b5f-ba23-abbecff2b8aa tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1279 microversion: 2.1 time: 0.091539 Jul 11 14:18:56.062422 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 539/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:55 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:57.082119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:57.083043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:57.089648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.090110 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.090928 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.091372 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.243810 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:57.251178 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ab7c1461-6a0d-45d0-a4f2-ee6238bef192 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.173924 Jul 11 14:18:57.251731 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 544/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:57 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:57.401144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-4654a9cc-55b2-413c-a913-e2ad09199a9d req-5dba1834-be24-40ed-9704-c5467c991517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3448580-15c9-4a50-8506-30a36ec669e3", "tag": "1c7e143a-757f-4835-ba18-2e430e8e1e8d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:18:57.412626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4654a9cc-55b2-413c-a913-e2ad09199a9d req-5dba1834-be24-40ed-9704-c5467c991517 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:57.413986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-4654a9cc-55b2-413c-a913-e2ad09199a9d req-5dba1834-be24-40ed-9704-c5467c991517 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:57.429909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-4654a9cc-55b2-413c-a913-e2ad09199a9d req-5dba1834-be24-40ed-9704-c5467c991517 service nova] Creating event network-changed:1c7e143a-757f-4835-ba18-2e430e8e1e8d for instance e3448580-15c9-4a50-8506-30a36ec669e3 on hv-cinder-84842 Jul 11 14:18:57.435265 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-4654a9cc-55b2-413c-a913-e2ad09199a9d req-5dba1834-be24-40ed-9704-c5467c991517 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038854 Jul 11 14:18:57.435879 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 540/1084] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:18:58.268262 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:58.269094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:58.276987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.277445 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.278221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:58.278696 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:58.418591 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:58.430558 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c7ab8c0d-249b-4778-94c1-4356b7ef842c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.161900 Jul 11 14:18:58.430558 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 545/1085] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:58 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:18:59.444426 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:18:59.445124 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:18:59.451814 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.452256 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.453011 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:18:59.453443 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:18:59.583174 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:18:59.590512 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-877c87cc-efca-439f-b64b-9cd2bb2edcee tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.150282 Jul 11 14:18:59.591082 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 541/1086] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:18:59 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:00.607296 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:00.607917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:00.614411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.614868 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.615636 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:00.616077 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:00.741983 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:00.749425 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a8e9359b-f8a0-4f44-9484-20b9f269124e tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.145882 Jul 11 14:19:00.749987 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 546/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:00 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:01.767063 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:01.767767 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:01.774395 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:01.774847 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:01.775608 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:01.776042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:01.905851 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:01.913910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-05fab19d-dd82-4917-9d46-2be09b16fe8b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.151616 Jul 11 14:19:01.914874 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 542/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:01 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:02.931793 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:02.932407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:02.938879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.939327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:02.940091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:02.940526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:03.065719 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:03.074045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5ee86f81-abf1-4b24-9d70-6d8510557539 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.147041 Jul 11 14:19:03.074670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 547/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:02 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:04.091368 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:04.092042 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:04.099098 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.099549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.100359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:04.100795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:04.234677 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:04.241693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-eb998d5c-273d-428c-b6f3-d5f81fbdd925 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.154196 Jul 11 14:19:04.242277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 543/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:04 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:05.259046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:05.259847 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:05.264135 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:05.269238 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.269847 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.270647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:05.271089 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:05.410526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:05.420142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ec613c75-42c6-45b1-a03b-3b669a4953c7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.165659 Jul 11 14:19:05.420739 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 548/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:05 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:06.437187 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:06.437797 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:06.439803 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:06.440555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:06.447093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:06.447540 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:06.448357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:06.448743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:06.578499 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:06.585992 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-86cf4eb7-4fad-43ed-bdc4-e27cf9f7dda7 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.152928 Jul 11 14:19:06.586583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 544/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:06 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:07.215057 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-18b42db2-f52f-4bb6-ad81-c447e30317b6 req-955e308d-6c66-4304-b38c-dc307dfbcc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3448580-15c9-4a50-8506-30a36ec669e3", "name": "network-vif-plugged", "status": "completed", "tag": "1c7e143a-757f-4835-ba18-2e430e8e1e8d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:07.224402 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-18b42db2-f52f-4bb6-ad81-c447e30317b6 req-955e308d-6c66-4304-b38c-dc307dfbcc6a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.225064 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-18b42db2-f52f-4bb6-ad81-c447e30317b6 req-955e308d-6c66-4304-b38c-dc307dfbcc6a service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.239008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-18b42db2-f52f-4bb6-ad81-c447e30317b6 req-955e308d-6c66-4304-b38c-dc307dfbcc6a service nova] Creating event network-vif-plugged:1c7e143a-757f-4835-ba18-2e430e8e1e8d for instance e3448580-15c9-4a50-8506-30a36ec669e3 on hv-cinder-84842 Jul 11 14:19:07.244957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-18b42db2-f52f-4bb6-ad81-c447e30317b6 req-955e308d-6c66-4304-b38c-dc307dfbcc6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033734 Jul 11 14:19:07.245853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 549/1093] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:07.602370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:07.602986 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:07.609729 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.610180 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.610995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:07.611468 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:07.742555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:07.750350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-38060e3f-d349-49d4-980f-7bc69b4dea5b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.152389 Jul 11 14:19:07.750937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 545/1094] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:07 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:08.768091 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:08.768798 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:08.775028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:08.775480 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.776235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:08.776769 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:08.908790 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:08.916937 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d5d468cf-2ddb-4d6e-b82e-868fd090c039 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1319 microversion: 2.1 time: 0.153476 Jul 11 14:19:08.917508 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 550/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:08 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:09.934010 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:09.935047 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:09.941288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.941740 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:09.942541 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:09.942976 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:10.081341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:10.088781 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-51b02164-ad85-4e06-95fe-44e224c46cc4 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1508 microversion: 2.1 time: 0.158923 Jul 11 14:19:10.089350 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 546/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:09 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:14.673436 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:14.674052 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:14.680963 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.681421 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.682196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.682734 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.708159 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:19:14.799296 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-0220aedd-d098-40cd-b451-887cf800fce3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 204 len: 0 microversion: 2.1 time: 0.129719 Jul 11 14:19:14.800191 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 551/1097] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:19:14 2022] DELETE /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:19:14.809192 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:14.809894 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:14.817183 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.817912 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.819701 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:14.820222 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:14.963909 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:14.971578 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ca1ef44b-d2a3-4545-adc7-2ae7daf4d1d6 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1576 microversion: 2.1 time: 0.166405 Jul 11 14:19:14.972143 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 547/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:14 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:15.990949 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:15.991765 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:15.999026 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:15.999618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.000395 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:16.000836 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:16.152333 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:16.159800 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-1f31dc7d-9dbb-4150-a9d3-3387445c6cb5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1576 microversion: 2.1 time: 0.174143 Jul 11 14:19:16.160367 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 552/1099] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:15 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:17.177690 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:17.178864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:17.186636 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.187085 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.187865 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.188302 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.346058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:17.354726 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-19bce12e-c67c-4fd4-a3bc-e5fe5a357ae7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1576 microversion: 2.1 time: 0.181197 Jul 11 14:19:17.355311 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 548/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:17 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:17.930025 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-f0a775b2-b768-4211-a176-d18921b3efa5 req-c3cf8897-57d5-4180-b318-3ac000b21be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2133fb7b-9f2f-4e3f-8d2c-73095a827fd4", "name": "network-vif-deleted", "tag": "2c145e97-2662-4d53-8a43-00bf731245fc"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:17.943673 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f0a775b2-b768-4211-a176-d18921b3efa5 req-c3cf8897-57d5-4180-b318-3ac000b21be0 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:17.944494 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f0a775b2-b768-4211-a176-d18921b3efa5 req-c3cf8897-57d5-4180-b318-3ac000b21be0 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:17.956970 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-f0a775b2-b768-4211-a176-d18921b3efa5 req-c3cf8897-57d5-4180-b318-3ac000b21be0 service nova] Creating event network-vif-deleted:2c145e97-2662-4d53-8a43-00bf731245fc for instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 on hv-cinder-84842 Jul 11 14:19:17.964124 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-f0a775b2-b768-4211-a176-d18921b3efa5 req-c3cf8897-57d5-4180-b318-3ac000b21be0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038120 Jul 11 14:19:17.965033 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 553/1101] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:18.372821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:18.373348 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:18.380116 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.380569 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.381374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:18.381791 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:18.446642 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:18.454861 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-6486f005-06eb-4d09-a3bf-28f887c98de3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.085929 Jul 11 14:19:18.455451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 549/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:18 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:19.472378 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:19.473098 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:19.479729 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.480169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.480919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:19.481348 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:19.542152 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:19.549833 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-868fac21-a0ff-43bb-8b1e-aeb41043d994 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.081398 Jul 11 14:19:19.550419 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 554/1103] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:19 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:20.567097 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:20.567700 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:20.574703 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.575144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.575896 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:20.576323 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:20.636770 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:20.644239 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-283b5013-a0c0-421b-bc9d-c9f46ff4d975 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.080984 Jul 11 14:19:20.644792 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 550/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:20 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:21.661024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:21.661642 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:21.668779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:21.669235 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:21.670008 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:21.670476 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:21.736469 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:21.743988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5aa2bac4-ee32-42d4-a619-aa2e53d167c5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.086820 Jul 11 14:19:21.744558 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 555/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:21 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:22.760928 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:22.761563 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:22.768156 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.768601 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:22.769357 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:22.769790 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:23.088825 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:23.096913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dc8d6a56-f946-4267-94f6-545da56580f5 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.339878 Jul 11 14:19:23.097498 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 551/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:22 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:24.114382 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:24.114971 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:24.121917 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:24.122398 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:24.123155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:24.123588 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:24.183857 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:24.191489 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-525765eb-3264-4b6a-b2d9-35b21d65a086 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.080938 Jul 11 14:19:24.192058 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 556/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:24 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:25.208570 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:25.210062 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:25.213393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:25.220071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:25.220516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:25.221283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:25.221795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:25.226461 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=77 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:25.284109 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:25.291754 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-46a843b9-91fc-4160-9833-0f71c7185c67 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 200 len: 1225 microversion: 2.1 time: 0.086959 Jul 11 14:19:25.292340 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 552/1108] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:25 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:26.309341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:26.309960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:26.312080 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:26.317208 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:26.317649 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.319070 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:26.319518 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.324183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:26.334390 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] HTTP exception thrown: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Request method failure captured: Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 HTTP/1.1 Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDCFxcMnHT9kkklKHCveMYG4CrIWIxW5cUuuoMblN97cblW0LSO2hsJet6CXx1U686qq3Fl-84xSBke1Rggt5kY0We7yhx8hESopoA6T0S5-y5GSv7Taer11ZOWjY4stOw_N_Gqyroe-7IJiY7fXGHv_imwAR8OwPGLWc-62OBuhMzs Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:19:26.335996 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_67d8660c31bf48e9a2c6a5edb2060bde", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}] Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestVolumeBootPattern-952684956 Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 3c85d19cf42f4688bbc89a439d96ca69 Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:19:26.337737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '2133fb7b-9f2f-4e3f-8d2c-73095a827fd4'} Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:19:26.338778 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:19:26.340380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:19:26.341889 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Returning 404 to user: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:19:26.341889 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-13b9c530-d828-43f8-b004-7eb7c1684341 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 404 len: 111 microversion: 2.1 time: 0.031941 Jul 11 14:19:26.341889 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 557/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:26 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:19:26.432562 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-991040932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-109109376", "security_groups": [{"name": "tempest-secgroup-smoke-331792550"}], "block_device_mapping_v2": [{"uuid": "77814d98-aa8b-488e-aee7-e8248715f609", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "399e9466-9fd1-4e23-afd7-ae28f17cf4de"}]}} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:26.541756 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.network.neutron [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] validate_networks() for [('399e9466-9fd1-4e23-afd7-ae28f17cf4de', None, None, None, None, None)] {{(pid=117980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:19:26.905733 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Flavor limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:19:26.906150 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Image limits 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:19:26.906661 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Flavor pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:19:26.907070 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Image pref 0:0:0 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:19:26.907487 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.virt.hardware [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:19:26.917550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:26.918017 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.918837 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:26.919267 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:26.936656 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:19:26.940741 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.quota [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for user 3c85d19cf42f4688bbc89a439d96ca69 and project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'instances', 'ram', 'cores'} {{(pid=117980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:19:26.997482 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Going to run 1 instances... {{(pid=117980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:19:26.999606 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77814d98-aa8b-488e-aee7-e8248715f609',volume_size=None,volume_type=None)] {{(pid=117980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:19:27.136619 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7757e97d-24aa-4fe8-af7d-318c5152b15f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708647 Jul 11 14:19:27.137272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 553/1110] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:19:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:19:27.148238 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a3841f25-3768-458f-9225-1fa0fbcef7cd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:27.148853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a3841f25-3768-458f-9225-1fa0fbcef7cd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:27.211149 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a3841f25-3768-458f-9225-1fa0fbcef7cd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:27.218095 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a3841f25-3768-458f-9225-1fa0fbcef7cd tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1093 microversion: 2.1 time: 0.074431 Jul 11 14:19:27.218607 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 558/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:27 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:28.241650 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:28.242907 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:28.249082 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.249535 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.250597 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:28.251071 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:28.320532 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:28.328200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-15af0a3e-3299-42b9-8b1d-aa6b785e87e9 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1199 microversion: 2.1 time: 0.091043 Jul 11 14:19:28.328768 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 554/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:28 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:29.344848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:29.345462 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:29.353474 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.353939 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.354798 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.355293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.509109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:29.517087 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-89dcf852-ead3-4f6d-a6d8-c919ad792d2a tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.175992 Jul 11 14:19:29.517669 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 559/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:29 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:29.649550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-0e637348-6b34-4d11-95a6-3ae91c540581 req-3e147150-beab-4f55-9aa6-88d6e8046879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a54aa-4081-430f-b08c-e9abf09978ea", "tag": "dd18d87b-e16c-4bc6-bf41-4bf41d35a33b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:29.665158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-0e637348-6b34-4d11-95a6-3ae91c540581 req-3e147150-beab-4f55-9aa6-88d6e8046879 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:29.667901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-0e637348-6b34-4d11-95a6-3ae91c540581 req-3e147150-beab-4f55-9aa6-88d6e8046879 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:29.686787 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-0e637348-6b34-4d11-95a6-3ae91c540581 req-3e147150-beab-4f55-9aa6-88d6e8046879 service nova] Creating event network-changed:dd18d87b-e16c-4bc6-bf41-4bf41d35a33b for instance 1f6a54aa-4081-430f-b08c-e9abf09978ea on hv-cinder-84842 Jul 11 14:19:29.692403 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-0e637348-6b34-4d11-95a6-3ae91c540581 req-3e147150-beab-4f55-9aa6-88d6e8046879 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048162 Jul 11 14:19:29.693093 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 555/1114] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:30.534349 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:30.534972 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:30.541497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:30.541946 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:30.542754 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:30.543198 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:30.674952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:30.683188 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a1684f47-0f97-45a5-a478-76c9b8d6a228 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.152761 Jul 11 14:19:30.683755 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 560/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:30 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:31.701327 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:31.702037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:31.708456 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:31.709509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:31.710271 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:31.710739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:31.870792 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:31.879312 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-0954e359-a40c-40c6-8481-3295bfee5323 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.182549 Jul 11 14:19:31.879840 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 556/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:31 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:32.897656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:32.898530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:32.905576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:32.906032 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:32.906848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:32.907347 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:33.055406 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:33.063184 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d33ee90c-ac2e-470d-9d7f-0810bb1755ed tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.169636 Jul 11 14:19:33.063761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 561/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:32 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:34.080949 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:34.081591 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:34.088806 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:34.089252 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:34.090015 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:34.090486 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:34.229151 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:34.237260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-954a6493-afcd-4e55-b7c1-c6ef92c10a85 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.160227 Jul 11 14:19:34.237849 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 557/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:34 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:35.254421 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:35.255160 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:35.261946 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:35.262434 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:35.263327 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:35.263775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:35.397512 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:35.405220 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9afb5dbc-ebdb-4dd5-bfb3-626ded044952 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.155110 Jul 11 14:19:35.405785 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 562/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:35 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:36.424938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:36.425652 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:36.434554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:36.435001 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:36.435892 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:36.436437 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:36.573709 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:36.581359 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9491e278-4fbd-441d-bbc0-1c2db55e5d07 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.161558 Jul 11 14:19:36.581941 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 558/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:36 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:36.816654 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1f30bd5-06de-4d13-87fd-7b099961db58", "device": "/dev/sdb"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:36.818257 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:36.824812 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:36.825260 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:36.826096 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:36.826576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.216185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:37.603964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:37.605105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:37.607661 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:37.608365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=6 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:37.616995 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:37.617452 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.618373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:37.618786 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:37.764036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:37.772335 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d1a639d2-8061-4e1f-9db1-f1ef7f5a4a7b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.176595 Jul 11 14:19:37.772942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 559/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:37 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:38.098659 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-be0f4914-ffdf-4c01-a428-e2d4b4dcfe9b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "POST /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.285458 Jul 11 14:19:38.099940 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 563/1122] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:19:36 2022] POST /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3/os-volume_attachments => generated 194 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:38.789418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:38.790031 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:38.796439 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:38.796893 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:38.797688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:38.798126 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:38.936002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:38.943994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d9445fb3-7f2d-4b3e-81ff-e50ad88d9ab4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.158375 Jul 11 14:19:38.944582 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 560/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:38 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:39.962952 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:39.963776 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:39.971202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:39.971698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:39.972503 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:39.972957 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:40.117185 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:40.124554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-db484d12-25d9-4a63-9575-5791c43460b0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.167109 Jul 11 14:19:40.125118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 564/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:39 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:41.141370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:41.142005 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:41.148698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:41.149143 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:41.149920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:41.150366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:41.304755 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:41.313102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c305aa43-8944-47a8-914d-1b469cd87239 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.175536 Jul 11 14:19:41.313688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 561/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:41 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:42.338625 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:42.339377 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:42.346167 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:42.346663 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:42.347455 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:42.347897 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:42.512579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:42.521113 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-77b64910-7ab6-4e5b-a2bf-5b88d2a9df12 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.186291 Jul 11 14:19:42.521711 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 565/1126] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:42 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:43.087504 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-ab53279c-800d-4fea-a32c-372b69cebce9 req-523bb80f-afab-4d22-a229-f5099de308ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a54aa-4081-430f-b08c-e9abf09978ea", "name": "network-vif-plugged", "status": "completed", "tag": "dd18d87b-e16c-4bc6-bf41-4bf41d35a33b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:43.096632 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-ab53279c-800d-4fea-a32c-372b69cebce9 req-523bb80f-afab-4d22-a229-f5099de308ab service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:43.097129 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-ab53279c-800d-4fea-a32c-372b69cebce9 req-523bb80f-afab-4d22-a229-f5099de308ab service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:43.110864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-ab53279c-800d-4fea-a32c-372b69cebce9 req-523bb80f-afab-4d22-a229-f5099de308ab service nova] Creating event network-vif-plugged:dd18d87b-e16c-4bc6-bf41-4bf41d35a33b for instance 1f6a54aa-4081-430f-b08c-e9abf09978ea on hv-cinder-84842 Jul 11 14:19:43.116155 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-ab53279c-800d-4fea-a32c-372b69cebce9 req-523bb80f-afab-4d22-a229-f5099de308ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034538 Jul 11 14:19:43.116782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 562/1127] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:19:43.538982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:43.539593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:43.546884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:43.547404 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:43.548169 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:43.548602 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:43.697554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:43.705679 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d2906d03-7ed3-4d67-983a-bed942102fa0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.170793 Jul 11 14:19:43.706274 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 566/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:43 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:44.724023 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:44.724750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:44.731830 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:44.732272 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:44.733046 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:44.733477 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:44.887263 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:44.895724 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9607a924-4bf8-4514-9194-ffc33186b2ee tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1264 microversion: 2.1 time: 0.175839 Jul 11 14:19:44.896354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 563/1129] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:44 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:45.915888 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:45.916879 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:45.927703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:45.928447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:45.929737 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:45.930466 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.088277 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:46.096804 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-8977271c-4559-4d88-9787-b164615122e1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1451 microversion: 2.1 time: 0.187765 Jul 11 14:19:46.097590 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 567/1130] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:45 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1451 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:19:46.113750 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:19:46.114835 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:19:46.121234 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:46.121684 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.122509 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:46.122944 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:46.279092 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:19:46.287191 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ea796270-e1df-4189-92f9-5503e4a8a2c4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1451 microversion: 2.1 time: 0.177270 Jul 11 14:19:46.287821 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 564/1131] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:19:46 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:19:48.376399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-bb60313d-e4f6-4dcd-8247-5e91f103b5aa req-ec63e219-2dbb-4d7f-8b4b-3d0d5a312d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a54aa-4081-430f-b08c-e9abf09978ea", "tag": "dd18d87b-e16c-4bc6-bf41-4bf41d35a33b"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:19:48.386432 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-bb60313d-e4f6-4dcd-8247-5e91f103b5aa req-ec63e219-2dbb-4d7f-8b4b-3d0d5a312d9b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:19:48.386942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-bb60313d-e4f6-4dcd-8247-5e91f103b5aa req-ec63e219-2dbb-4d7f-8b4b-3d0d5a312d9b service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:19:48.399270 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-bb60313d-e4f6-4dcd-8247-5e91f103b5aa req-ec63e219-2dbb-4d7f-8b4b-3d0d5a312d9b service nova] Creating event network-changed:dd18d87b-e16c-4bc6-bf41-4bf41d35a33b for instance 1f6a54aa-4081-430f-b08c-e9abf09978ea on hv-cinder-84842 Jul 11 14:19:48.404635 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-bb60313d-e4f6-4dcd-8247-5e91f103b5aa req-ec63e219-2dbb-4d7f-8b4b-3d0d5a312d9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031972 Jul 11 14:19:48.405250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 568/1132] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:20:11.185659 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:11.186176 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:11.188472 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:11.189121 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=65 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:11.196400 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:11.196857 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:11.197662 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:11.198105 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:11.279484 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lazy-loading 'services' on Instance uuid e3448580-15c9-4a50-8506-30a36ec669e3 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:20:11.352000 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f5959aff-5447-420b-bc49-302812d3c35d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3/os-volume_attachments/f1f30bd5-06de-4d13-87fd-7b099961db58" status: 202 len: 0 microversion: 2.1 time: 0.170032 Jul 11 14:20:11.352676 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 565/1133] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:20:11 2022] DELETE /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3/os-volume_attachments/f1f30bd5-06de-4d13-87fd-7b099961db58 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:20:12.476618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=25 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:12.477375 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:12.481772 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:12.482444 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:12.490848 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:12.491300 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:12.492076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:12.492513 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:12.519341 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:20:12.602883 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-93ac24cb-cabd-4bcb-967a-c2ff336628d9 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 204 len: 0 microversion: 2.1 time: 0.127364 Jul 11 14:20:12.603606 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 569/1134] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:20:12 2022] DELETE /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:20:12.612957 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:12.613702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:12.620391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:12.620846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:12.621616 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:12.622053 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:12.749737 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:12.757298 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-341ece2d-bf1f-49b1-9d87-8be629085087 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1514 microversion: 2.1 time: 0.148616 Jul 11 14:20:12.757871 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 566/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:12 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:13.775119 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:13.775795 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:13.782279 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:13.782745 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:13.783527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:13.783921 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:13.970559 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:13.980194 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-216e4b8f-b725-4395-a65e-eb38b9dbbbb2 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1514 microversion: 2.1 time: 0.209005 Jul 11 14:20:13.980806 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 570/1136] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:13 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:15.000185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:15.001371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:15.008185 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.008625 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.009428 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.010036 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.193689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:15.194717 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-b0472741-46f3-4352-b088-7c69aee48919 req-57ce9b73-1595-41cc-b998-58a935d2a530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3448580-15c9-4a50-8506-30a36ec669e3", "name": "network-vif-deleted", "tag": "1c7e143a-757f-4835-ba18-2e430e8e1e8d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:15.203188 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-75c31209-a9c7-4c44-9dbc-fd946229949d tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 200 len: 1514 microversion: 2.1 time: 0.206208 Jul 11 14:20:15.204021 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 567/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:14 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:15.219381 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b0472741-46f3-4352-b088-7c69aee48919 req-57ce9b73-1595-41cc-b998-58a935d2a530 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:15.220089 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-b0472741-46f3-4352-b088-7c69aee48919 req-57ce9b73-1595-41cc-b998-58a935d2a530 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:15.232279 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-b0472741-46f3-4352-b088-7c69aee48919 req-57ce9b73-1595-41cc-b998-58a935d2a530 service nova] Creating event network-vif-deleted:1c7e143a-757f-4835-ba18-2e430e8e1e8d for instance e3448580-15c9-4a50-8506-30a36ec669e3 on hv-cinder-84842 Jul 11 14:20:15.237924 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-b0472741-46f3-4352-b088-7c69aee48919 req-57ce9b73-1595-41cc-b998-58a935d2a530 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049937 Jul 11 14:20:15.238653 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 571/1138] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:20:16.221603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:16.222224 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: e3448580-15c9-4a50-8506-30a36ec669e3] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:16.229282 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.229731 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.230533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:16.230964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:16.244852 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] HTTP exception thrown: Instance e3448580-15c9-4a50-8506-30a36ec669e3 could not be found. Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Request method failure captured: Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 HTTP/1.1 Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizDFIsfmqwJtJNXDP7v7K7CSW9kRFFntD42XrbBhR1hn--GHorFN4FvT46PWhTr4Kcc8ZultwFr6HOMR2glfQwiS00v6T_520uwlMXN25CWp5Gcp1ny85rvixomkF_Rq5mgFUwK1Bpszook-5SeoURaefUwkPpeUiUNNO1JWUei19KCw Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 58346265e4c244dcb15cd6ec2817773a Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1833927142 Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:20:16.246533 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58346265e4c244dcb15cd6ec2817773a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58346265e4c244dcb15cd6ec2817773a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58346265e4c244dcb15cd6ec2817773a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58346265e4c244dcb15cd6ec2817773a"}]}] Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesSnapshotTestJSON-1833927142 Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 58346265e4c244dcb15cd6ec2817773a Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1833927142 Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesSnapshotTestJSON-1833927142-project Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 72a0be934143483e8cdcc25fb7b3c915 Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesSnapshotTestJSON-1833927142-project Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance e3448580-15c9-4a50-8506-30a36ec669e3 could not be found. Jul 11 14:20:16.248341 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'e3448580-15c9-4a50-8506-30a36ec669e3'} Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3448580-15c9-4a50-8506-30a36ec669e3 could not be found. Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:20:16.249240 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3448580-15c9-4a50-8506-30a36ec669e3 could not be found. Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3448580-15c9-4a50-8506-30a36ec669e3 could not be found. Jul 11 14:20:16.250693 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:20:16.251889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Returning 404 to user: Instance e3448580-15c9-4a50-8506-30a36ec669e3 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:20:16.251889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-457faee7-be80-4ce1-8249-0eaf05a74c99 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3" status: 404 len: 111 microversion: 2.1 time: 0.030232 Jul 11 14:20:16.251889 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 568/1139] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:16 2022] GET /compute/v2.1/servers/e3448580-15c9-4a50-8506-30a36ec669e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:26.392091 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:20:26.393116 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:20:31.299311 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:31.300297 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:31.305085 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1577751701", "imageRef": "09ecacae-ce50-4ed8-8d15-d74e07456703", "flavorRef": "452", "networks": [{"uuid": "9042c877-52fd-4c28-9ce3-19f99d46d913"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:31.358960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] validate_networks() for [('9042c877-52fd-4c28-9ce3-19f99d46d913', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:20:31.790411 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:20:31.790838 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:20:31.791311 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:20:31.791720 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:20:31.792131 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:20:31.801608 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:31.802067 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:31.802923 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:31.803361 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:31.820770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Getting quotas for project 58346265e4c244dcb15cd6ec2817773a. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:20:31.825118 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Getting quotas for user 72a0be934143483e8cdcc25fb7b3c915 and project 58346265e4c244dcb15cd6ec2817773a. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:20:31.836954 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:20:31.839314 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09ecacae-ce50-4ed8-8d15-d74e07456703',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:20:31.880013 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [c36998ba-939c-4aed-9504-75c007fb804c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 14:20:32.887698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [c36998ba-939c-4aed-9504-75c007fb804c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41956. Jul 11 14:20:32.891507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-4d03b0af-c478-45ec-b42a-63ffe46155d3 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593767 Jul 11 14:20:32.892243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 572/1140] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:20:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:20:32.902108 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-b1732581-a7cd-4840-91b9-abca9545007f tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:32.902753 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-b1732581-a7cd-4840-91b9-abca9545007f tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:32.905295 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=8 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:32.905954 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:32.959851 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-b1732581-a7cd-4840-91b9-abca9545007f tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:32.967374 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-b1732581-a7cd-4840-91b9-abca9545007f tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1219 microversion: 2.1 time: 0.069055 Jul 11 14:20:32.967933 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 569/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:32 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:33.984304 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:33.984904 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:33.992370 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:33.992816 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:33.993574 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:33.994005 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:34.057103 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:34.064568 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bffcf5d6-8edd-43a0-b643-086849a5c503 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1277 microversion: 2.1 time: 0.084108 Jul 11 14:20:34.065140 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 573/1142] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:33 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:35.081090 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:35.081705 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:35.088251 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:35.088698 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:35.089469 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:35.089901 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:35.199909 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-f2d0a488-5887-40ca-bd43-ab0373b43802 req-347a522a-4bf9-440e-9cc0-39c3e8911bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef19d665-a064-490c-8645-20eb72a98c04", "tag": "db51170d-1d31-480f-bfc0-7b69fccba9cc"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:35.211004 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f2d0a488-5887-40ca-bd43-ab0373b43802 req-347a522a-4bf9-440e-9cc0-39c3e8911bf3 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:35.211464 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-f2d0a488-5887-40ca-bd43-ab0373b43802 req-347a522a-4bf9-440e-9cc0-39c3e8911bf3 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:35.230984 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-f2d0a488-5887-40ca-bd43-ab0373b43802 req-347a522a-4bf9-440e-9cc0-39c3e8911bf3 service nova] Creating event network-changed:db51170d-1d31-480f-bfc0-7b69fccba9cc for instance ef19d665-a064-490c-8645-20eb72a98c04 on hv-cinder-84842 Jul 11 14:20:35.236866 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-f2d0a488-5887-40ca-bd43-ab0373b43802 req-347a522a-4bf9-440e-9cc0-39c3e8911bf3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042350 Jul 11 14:20:35.237478 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 574/1143] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:20:35.249775 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:35.257913 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c54648b7-e36b-495c-b664-795663f90e2b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.180703 Jul 11 14:20:35.258501 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 570/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:35 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:36.276321 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:36.277022 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:36.283343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:36.283798 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:36.284561 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:36.285003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:36.417430 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:36.425120 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2221d06c-5247-44e4-9e7f-0486e2dd2c53 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.153555 Jul 11 14:20:36.425680 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 575/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:36 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:37.441925 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:37.442566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:37.448672 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.449110 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.449864 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:37.450288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:37.581412 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:37.590974 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-32dc97bd-1521-47b8-9c01-e0e0c777e3cc tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.152273 Jul 11 14:20:37.591194 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 571/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:37 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:38.608179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:38.608705 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:38.616060 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:38.616501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:38.617250 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:38.617678 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:38.746383 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:38.753618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-d2e7a51d-aa4d-4cb4-8d72-52d26dbd50fe tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.149332 Jul 11 14:20:38.754180 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 576/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:38 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:39.770657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:39.771280 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:39.778158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:39.778718 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:39.779492 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:39.779929 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:39.915688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:39.923150 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-5004a833-8d28-4768-8452-ba140d177a1c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.156706 Jul 11 14:20:39.923713 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 572/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:39 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:40.941526 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:40.942142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:40.948567 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:40.949019 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:40.949813 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:40.950248 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:41.229524 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:41.237206 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-334bf8c6-c716-4057-b705-f55086233da8 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.300173 Jul 11 14:20:41.238329 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 577/1149] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:40 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:20:41.287320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-98b293bf-8083-43e2-b65f-e5bc70b27f98 req-c48bf2b9-e4dd-4fb0-b953-f83dcf703791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19d665-a064-490c-8645-20eb72a98c04", "name": "network-vif-plugged", "status": "completed", "tag": "db51170d-1d31-480f-bfc0-7b69fccba9cc"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:41.296112 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-98b293bf-8083-43e2-b65f-e5bc70b27f98 req-c48bf2b9-e4dd-4fb0-b953-f83dcf703791 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:41.296579 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-98b293bf-8083-43e2-b65f-e5bc70b27f98 req-c48bf2b9-e4dd-4fb0-b953-f83dcf703791 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:41.309841 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-98b293bf-8083-43e2-b65f-e5bc70b27f98 req-c48bf2b9-e4dd-4fb0-b953-f83dcf703791 service nova] Creating event network-vif-plugged:db51170d-1d31-480f-bfc0-7b69fccba9cc for instance ef19d665-a064-490c-8645-20eb72a98c04 on hv-cinder-84842 Jul 11 14:20:41.314732 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-98b293bf-8083-43e2-b65f-e5bc70b27f98 req-c48bf2b9-e4dd-4fb0-b953-f83dcf703791 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031483 Jul 11 14:20:41.315322 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 573/1150] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:20:42.255043 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:42.255666 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:42.257597 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:42.258254 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:42.264433 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:42.264881 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:42.265637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:42.266074 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:42.392713 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:42.400661 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3a23cf2b-1b97-437a-a310-03f97de3af3b tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1319 microversion: 2.1 time: 0.150081 Jul 11 14:20:42.401229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 578/1151] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:42 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:43.418739 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:20:43.419458 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:43.422069 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:43.427900 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:43.428345 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:43.429113 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:43.429527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:43.561630 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:20:43.569048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-9fed3936-140d-442d-86b4-87794fe405a0 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1509 microversion: 2.1 time: 0.155708 Jul 11 14:20:43.569607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 574/1152] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:20:43 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:20:43.585638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32e421b3-cb1a-4008-8b11-7b55fdce0c08", "device": "/dev/sdb"}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:20:43.586764 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:20:43.593203 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:43.593656 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:43.594456 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:20:43.594904 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:20:43.841805 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3fb127c7-fa66-4d50-a9e1-0375a7d2ca10 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "POST /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260336 Jul 11 14:20:43.842435 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 579/1153] 10.222.0.49 () {60 vars in 1322 bytes} [Mon Jul 11 14:20:43 2022] POST /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:05.171371 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:05.171881 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:05.174201 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=14 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:05.175217 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=26 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:05.181139 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:05.181581 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:05.182370 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:05.182802 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:05.264560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.objects.instance [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lazy-loading 'services' on Instance uuid ef19d665-a064-490c-8645-20eb72a98c04 {{(pid=117980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 11 14:21:05.343506 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4f8b1327-e8b0-4559-bc32-e1b529408001 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04/os-volume_attachments/32e421b3-cb1a-4008-8b11-7b55fdce0c08" status: 202 len: 0 microversion: 2.1 time: 0.175390 Jul 11 14:21:05.344200 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 575/1154] 10.222.0.49 () {58 vars in 1415 bytes} [Mon Jul 11 14:21:05 2022] DELETE /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04/os-volume_attachments/32e421b3-cb1a-4008-8b11-7b55fdce0c08 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 11 14:21:06.455975 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:06.456774 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:06.461028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:06.461647 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:06.469330 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:06.469750 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:06.470550 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:06.470994 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:06.497976 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:21:06.572263 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-c3b0b95a-7d38-4b03-9d65-e39dae448092 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 204 len: 0 microversion: 2.1 time: 0.117579 Jul 11 14:21:06.572773 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 580/1155] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:21:06 2022] DELETE /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:21:06.583554 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:06.584413 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:06.590937 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:06.591384 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:06.592158 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:06.592595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:06.722417 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:06.729932 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-79336605-4664-480e-8c98-44c044449d4c tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1515 microversion: 2.1 time: 0.151602 Jul 11 14:21:06.730567 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 576/1156] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:06 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:07.748638 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:07.749288 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:07.756243 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:07.756688 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:07.757472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:07.757907 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:07.887960 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:07.895643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-9d2d002e-4137-4a7b-96dc-c9634928a2da tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1515 microversion: 2.1 time: 0.151659 Jul 11 14:21:07.896215 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 581/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:07 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:08.912639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:08.913322 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:08.919934 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:08.920381 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:08.921139 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:08.921574 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:09.049026 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a0be934143483e8cdcc25fb7b3c915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58346265e4c244dcb15cd6ec2817773a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:21:09.057380 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2bbaffa4-2018-45cd-b6a1-f9ea00d1dfde tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 200 len: 1515 microversion: 2.1 time: 0.148605 Jul 11 14:21:09.057947 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 577/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:08 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:21:09.440566 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-6722e71e-8150-4ed2-88ff-e422bdc51048 req-93feb0b4-9284-4e81-9ec1-d653c6a61055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef19d665-a064-490c-8645-20eb72a98c04", "name": "network-vif-deleted", "tag": "db51170d-1d31-480f-bfc0-7b69fccba9cc"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:21:09.449202 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6722e71e-8150-4ed2-88ff-e422bdc51048 req-93feb0b4-9284-4e81-9ec1-d653c6a61055 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:09.449643 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-6722e71e-8150-4ed2-88ff-e422bdc51048 req-93feb0b4-9284-4e81-9ec1-d653c6a61055 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:09.465645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-6722e71e-8150-4ed2-88ff-e422bdc51048 req-93feb0b4-9284-4e81-9ec1-d653c6a61055 service nova] Creating event network-vif-deleted:db51170d-1d31-480f-bfc0-7b69fccba9cc for instance ef19d665-a064-490c-8645-20eb72a98c04 on hv-cinder-84842 Jul 11 14:21:09.470671 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-6722e71e-8150-4ed2-88ff-e422bdc51048 req-93feb0b4-9284-4e81-9ec1-d653c6a61055 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033737 Jul 11 14:21:09.472038 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 582/1159] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:21:10.074639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:21:10.075309 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] [instance: ef19d665-a064-490c-8645-20eb72a98c04] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:21:10.082485 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:10.082936 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:10.083702 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:21:10.084139 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:21:10.097278 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] HTTP exception thrown: Instance ef19d665-a064-490c-8645-20eb72a98c04 could not be found. Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Request method failure captured: Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 HTTP/1.1 Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizDFIsfmqwJtJNXDP7v7K7CSW9kRFFntD42XrbBhR1hn--GHorFN4FvT46PWhTr4Kcc8ZultwFr6HOMR2glfQwiS00v6T_520uwlMXN25CWp5Gcp1ny85rvixomkF_Rq5mgFUwK1Bpszook-5SeoURaefUwkPpeUiUNNO1JWUei19KCw Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 58346265e4c244dcb15cd6ec2817773a Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1833927142 Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:21:10.098942 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_58346265e4c244dcb15cd6ec2817773a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58346265e4c244dcb15cd6ec2817773a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/58346265e4c244dcb15cd6ec2817773a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/58346265e4c244dcb15cd6ec2817773a"}]}] Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-VolumesSnapshotTestJSON-1833927142 Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 58346265e4c244dcb15cd6ec2817773a Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1833927142 Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-VolumesSnapshotTestJSON-1833927142-project Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 72a0be934143483e8cdcc25fb7b3c915 Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-VolumesSnapshotTestJSON-1833927142-project Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance ef19d665-a064-490c-8645-20eb72a98c04 could not be found. Jul 11 14:21:10.100751 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': 'ef19d665-a064-490c-8645-20eb72a98c04'} Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef19d665-a064-490c-8645-20eb72a98c04 could not be found. Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:21:10.101789 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef19d665-a064-490c-8645-20eb72a98c04 could not be found. Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef19d665-a064-490c-8645-20eb72a98c04 could not be found. Jul 11 14:21:10.103583 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:21:10.105354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] Returning 404 to user: Instance ef19d665-a064-490c-8645-20eb72a98c04 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:21:10.105354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-ad71ecf1-de7f-453f-8985-ba8e5ea782a5 tempest-VolumesSnapshotTestJSON-1833927142 tempest-VolumesSnapshotTestJSON-1833927142-project] 10.222.0.49 "GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04" status: 404 len: 111 microversion: 2.1 time: 0.029613 Jul 11 14:21:10.105354 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 578/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:21:10 2022] GET /compute/v2.1/servers/ef19d665-a064-490c-8645-20eb72a98c04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:22:02.549988 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:22:02.550634 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:22:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:22:16.148967 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:16.149753 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:16.155014 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1436371146", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-109109376", "security_groups": [{"name": "tempest-secgroup-smoke-331792550"}], "block_device_mapping_v2": [{"uuid": "4cb6382f-63ec-49b6-a56c-f6e08c2331bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "399e9466-9fd1-4e23-afd7-ae28f17cf4de"}]}} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:16.386657 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.network.neutron [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] validate_networks() for [('399e9466-9fd1-4e23-afd7-ae28f17cf4de', None, None, None, None, None)] {{(pid=117981) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 11 14:22:16.746345 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Flavor limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 11 14:22:16.746779 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Image limits 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 11 14:22:16.747258 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Flavor pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 11 14:22:16.747670 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Image pref 0:0:0 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 11 14:22:16.748086 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.virt.hardware [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117981) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 11 14:22:16.756892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:16.757343 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:16.758145 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:16.758616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:16.775733 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 11 14:22:16.779665 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.quota [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Getting quotas for user 3c85d19cf42f4688bbc89a439d96ca69 and project 67d8660c31bf48e9a2c6a5edb2060bde. Resources: {'instances', 'ram', 'cores'} {{(pid=117981) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 11 14:22:16.841221 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Going to run 1 instances... {{(pid=117981) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 11 14:22:16.843554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cb6382f-63ec-49b6-a56c-f6e08c2331bb',volume_size=None,volume_type=None)] {{(pid=117981) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 11 14:22:16.970396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-38fb438b-b1ea-4568-897f-04de7ee2e134 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823735 Jul 11 14:22:16.971045 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 583/1161] 10.222.0.49 () {60 vars in 1146 bytes} [Mon Jul 11 14:22:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 11 14:22:16.981964 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-d8ed64c7-a73e-4083-9297-aa1c9eefde14 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:16.982597 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-d8ed64c7-a73e-4083-9297-aa1c9eefde14 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:16.984891 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=8 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:16.985622 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:17.153409 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-d8ed64c7-a73e-4083-9297-aa1c9eefde14 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:17.162603 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-d8ed64c7-a73e-4083-9297-aa1c9eefde14 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1094 microversion: 2.1 time: 0.185483 Jul 11 14:22:17.163177 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 579/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:16 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1094 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:18.180300 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:18.181579 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:18.188089 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.188620 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.189479 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:18.189990 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:18.251183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:18.258775 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-17935a74-9ac0-4493-af3f-5c6032828add tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1210 microversion: 2.1 time: 0.082830 Jul 11 14:22:18.259962 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 584/1163] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:18 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:19.277451 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:19.278058 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:19.285555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:19.286002 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:19.286781 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:19.287211 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:19.435430 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:19.444629 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-7b2e6d01-0b4a-463e-8c3b-8624e16b954f tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.171669 Jul 11 14:22:19.445280 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 580/1164] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:19 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:19.601730 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-65324923-aba3-400d-be77-b48e9632b692 req-39bb233e-ee96-4cf9-8e77-fd9f67ae5bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063e140e-70f9-429a-80c2-89939549e287", "tag": "45ec1e0e-8036-4531-a6bd-1615d8f70f0d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:19.617441 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-65324923-aba3-400d-be77-b48e9632b692 req-39bb233e-ee96-4cf9-8e77-fd9f67ae5bbf service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:19.618111 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-65324923-aba3-400d-be77-b48e9632b692 req-39bb233e-ee96-4cf9-8e77-fd9f67ae5bbf service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:19.632003 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-65324923-aba3-400d-be77-b48e9632b692 req-39bb233e-ee96-4cf9-8e77-fd9f67ae5bbf service nova] Creating event network-changed:45ec1e0e-8036-4531-a6bd-1615d8f70f0d for instance 063e140e-70f9-429a-80c2-89939549e287 on hv-cinder-84842 Jul 11 14:22:19.639184 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-65324923-aba3-400d-be77-b48e9632b692 req-39bb233e-ee96-4cf9-8e77-fd9f67ae5bbf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041154 Jul 11 14:22:19.639796 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 585/1165] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:20.462983 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:20.463572 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:20.470048 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:20.470525 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:20.471281 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:20.471711 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:20.629869 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:20.639223 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-607f3545-7946-451e-9066-5b06da894136 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.180542 Jul 11 14:22:20.639809 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 581/1166] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:20 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:21.657369 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:21.658075 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:21.665693 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:21.666142 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:21.666951 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:21.667399 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:21.819710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:21.828196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-918d14df-e186-4a00-bba5-d872067094f0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.175715 Jul 11 14:22:21.828762 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 586/1167] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:21 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:22.846049 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:22.846903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:22.853924 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:22.854393 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:22.855162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:22.855595 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:22.999831 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:23.007784 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-286f0b5e-375a-4b3c-a056-df10180451ce tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.165596 Jul 11 14:22:23.008376 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 582/1168] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:22 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:22:24.024897 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:24.025573 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:24.033253 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:24.033700 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:24.034519 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:24.034966 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:24.182109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:24.190046 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-e9bc8e61-ef7f-4c08-866e-45699c17a3f2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.168801 Jul 11 14:22:24.190660 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 587/1169] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:24 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 11 14:22:25.207289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:25.207903 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:25.214793 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:25.215252 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:25.216542 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:25.216989 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:25.363343 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:25.370950 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cf3b7ff4-bcea-4a7b-afc4-064d20c174a7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.167501 Jul 11 14:22:25.371527 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 583/1170] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:25 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:26.387506 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:26.388109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:26.394471 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:26.394942 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:26.395707 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:26.396136 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:26.561270 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:26.569128 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-66d32804-0478-4d69-9e08-221b8bbb96d8 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.185483 Jul 11 14:22:26.569995 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 588/1171] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:26 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:27.596982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:27.597763 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:27.601263 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell0:SELECT=2 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:27.608585 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:27.609056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:27.609846 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:27.610313 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:27.772657 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:27.780363 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-19906c7e-e865-49dd-bf6d-98129df718d1 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.187165 Jul 11 14:22:27.781186 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 584/1172] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:27 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:28.797556 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:28.798229 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:28.800428 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=2 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:28.801122 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell0:SELECT=6 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:28.808533 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:28.809037 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:28.809919 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:28.810447 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:28.958645 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:28.967771 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-2980cb31-d012-4161-a970-8710e2438379 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.174054 Jul 11 14:22:28.968346 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 589/1173] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:28 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:29.989084 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:29.989689 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:29.996457 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:29.996910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:29.997688 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:29.998127 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:30.132643 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:30.140039 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-dfa8a77c-13e0-4c86-9497-687562985aa2 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.154884 Jul 11 14:22:30.140530 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 585/1174] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:29 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:31.156932 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:31.157537 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:31.164002 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:31.164445 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:31.165698 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:31.166189 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:31.293275 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:31.301109 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-a4252a39-44c8-4b3a-8b19-f2acbc502267 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.148092 Jul 11 14:22:31.301667 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 590/1175] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:31 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:31.805037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-7c1eaeac-b673-423d-8776-d0bdd0663aaa req-0ad5efc1-2f87-4019-822e-322591d8e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e140e-70f9-429a-80c2-89939549e287", "name": "network-vif-plugged", "status": "completed", "tag": "45ec1e0e-8036-4531-a6bd-1615d8f70f0d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:31.814959 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-7c1eaeac-b673-423d-8776-d0bdd0663aaa req-0ad5efc1-2f87-4019-822e-322591d8e9f3 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:31.815365 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-7c1eaeac-b673-423d-8776-d0bdd0663aaa req-0ad5efc1-2f87-4019-822e-322591d8e9f3 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:31.827373 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-7c1eaeac-b673-423d-8776-d0bdd0663aaa req-0ad5efc1-2f87-4019-822e-322591d8e9f3 service nova] Creating event network-vif-plugged:45ec1e0e-8036-4531-a6bd-1615d8f70f0d for instance 063e140e-70f9-429a-80c2-89939549e287 on hv-cinder-84842 Jul 11 14:22:31.832516 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-7c1eaeac-b673-423d-8776-d0bdd0663aaa req-0ad5efc1-2f87-4019-822e-322591d8e9f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031181 Jul 11 14:22:31.833125 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 586/1176] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:22:32.318133 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:32.318784 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:32.325891 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:32.326380 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:32.327148 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:32.327589 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:32.455982 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:32.463593 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-f54b2cde-a31f-42c8-be61-3ebb244983e0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.149329 Jul 11 14:22:32.464155 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 591/1177] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:32 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:33.481746 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:33.482473 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:33.488816 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:33.489260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:33.490037 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:33.490518 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:33.626743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:33.635795 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-4f0762d5-f608-466f-8dd1-65f3ae9d9d84 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1265 microversion: 2.1 time: 0.158790 Jul 11 14:22:33.636418 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 587/1178] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:33 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:34.653853 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:34.654497 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:34.661073 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.661527 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.662319 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.662761 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.792476 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:34.800287 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-ace00ca5-c306-4842-9118-e229811da47d tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1452 microversion: 2.1 time: 0.150752 Jul 11 14:22:34.800842 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 592/1179] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:34 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:34.816546 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:22:34.817162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:22:34.823883 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.824335 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.825111 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:34.825549 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:34.967711 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:22:34.975683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-8360e470-4cc2-430c-947f-5d79e32fc180 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1452 microversion: 2.1 time: 0.162925 Jul 11 14:22:34.976277 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 588/1180] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:22:34 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:22:37.145876 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-ddfba2ac-6c85-4faa-a379-4d109d98c5cc req-fc5a058b-af30-4fae-b039-7feb89142811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063e140e-70f9-429a-80c2-89939549e287", "tag": "45ec1e0e-8036-4531-a6bd-1615d8f70f0d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:22:37.154028 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ddfba2ac-6c85-4faa-a379-4d109d98c5cc req-fc5a058b-af30-4fae-b039-7feb89142811 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:22:37.154594 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-ddfba2ac-6c85-4faa-a379-4d109d98c5cc req-fc5a058b-af30-4fae-b039-7feb89142811 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:22:37.166653 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-ddfba2ac-6c85-4faa-a379-4d109d98c5cc req-fc5a058b-af30-4fae-b039-7feb89142811 service nova] Creating event network-changed:45ec1e0e-8036-4531-a6bd-1615d8f70f0d for instance 063e140e-70f9-429a-80c2-89939549e287 on hv-cinder-84842 Jul 11 14:22:37.171703 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-ddfba2ac-6c85-4faa-a379-4d109d98c5cc req-fc5a058b-af30-4fae-b039-7feb89142811 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094740 Jul 11 14:22:37.172311 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 593/1181] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:23:46.402230 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:23:46.402867 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:24:26.998102 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_api:SELECT=22 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:27.002027 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c5ab3e2c-4e46-440c-8d9c-f7f1b6bdcf57] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 11 14:24:27.002730 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:27.003576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG dbcounter [-] [117981] Writing DB stats nova_cell1:SELECT=54 {{(pid=117981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:27.003764 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG dbcounter [-] [117980] Writing DB stats nova_cell1:SELECT=50 {{(pid=117980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:27.008297 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:27.008800 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:27.024161 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.024618 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.025414 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.025856 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.055917 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Going to try to terminate instance {{(pid=117980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:24:27.080710 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [req-d3974ec2-aae4-451e-82bd-9d2cf0b7af54 req-b2dd79fb-2d33-42ce-a9e9-17077318eea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063e140e-70f9-429a-80c2-89939549e287", "tag": "45ec1e0e-8036-4531-a6bd-1615d8f70f0d"}]} {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:27.089293 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-d3974ec2-aae4-451e-82bd-9d2cf0b7af54 req-b2dd79fb-2d33-42ce-a9e9-17077318eea5 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.090507 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [req-d3974ec2-aae4-451e-82bd-9d2cf0b7af54 req-b2dd79fb-2d33-42ce-a9e9-17077318eea5 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.102618 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.compute.server_external_events [req-d3974ec2-aae4-451e-82bd-9d2cf0b7af54 req-b2dd79fb-2d33-42ce-a9e9-17077318eea5 service nova] Creating event network-changed:45ec1e0e-8036-4531-a6bd-1615d8f70f0d for instance 063e140e-70f9-429a-80c2-89939549e287 on hv-cinder-84842 Jul 11 14:24:27.108457 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [req-d3974ec2-aae4-451e-82bd-9d2cf0b7af54 req-b2dd79fb-2d33-42ce-a9e9-17077318eea5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107867 Jul 11 14:24:27.109172 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 594/1182] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:27.163358 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-913d99ee-b33d-44bb-af64-23f78aad374b tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 204 len: 0 microversion: 2.1 time: 0.166716 Jul 11 14:24:27.164668 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 589/1183] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:24:26 2022] DELETE /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:24:27.175242 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:27.176034 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:27.183418 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.183855 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.184637 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:27.185076 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:27.341472 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:27.351726 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-fec3d2b7-c23f-4a69-b0be-903bb6b0b5b7 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1577 microversion: 2.1 time: 0.180892 Jul 11 14:24:27.352265 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 595/1184] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:27 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:28.369782 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:28.370813 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:28.379196 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:28.379649 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:28.380493 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:28.381009 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:28.542320 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:28.556424 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-2aeeaa8c-6b11-4904-9508-b51548f51349 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1577 microversion: 2.1 time: 0.190380 Jul 11 14:24:28.557560 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 590/1185] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:28 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:29.586179 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:29.587107 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:29.594854 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-8485d5c0-53cb-47a8-be34-d561f52ee05e req-5d6532d5-3174-46b4-b733-596eaad9e8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063e140e-70f9-429a-80c2-89939549e287", "name": "network-vif-deleted", "tag": "45ec1e0e-8036-4531-a6bd-1615d8f70f0d"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:29.599272 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] [c5ab3e2c-4e46-440c-8d9c-f7f1b6bdcf57] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42424. Jul 11 14:24:29.603989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:29.604490 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:29.604626 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8485d5c0-53cb-47a8-be34-d561f52ee05e req-5d6532d5-3174-46b4-b733-596eaad9e8b1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:29.604994 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-8485d5c0-53cb-47a8-be34-d561f52ee05e req-5d6532d5-3174-46b4-b733-596eaad9e8b1 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:29.605396 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:29.605878 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:29.618489 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-8485d5c0-53cb-47a8-be34-d561f52ee05e req-5d6532d5-3174-46b4-b733-596eaad9e8b1 service nova] Creating event network-vif-deleted:45ec1e0e-8036-4531-a6bd-1615d8f70f0d for instance 063e140e-70f9-429a-80c2-89939549e287 on hv-cinder-84842 Jul 11 14:24:29.624685 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-8485d5c0-53cb-47a8-be34-d561f52ee05e req-5d6532d5-3174-46b4-b733-596eaad9e8b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Jul 11 14:24:29.625463 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 591/1186] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:24:29.674143 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:29.682049 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-bf1bafdc-463e-4056-8160-b3c83ecaeae0 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 200 len: 1391 microversion: 2.1 time: 0.099932 Jul 11 14:24:29.682434 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 596/1187] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:29 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 1391 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:30.700982 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:30.701773 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 063e140e-70f9-429a-80c2-89939549e287] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:30.708468 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:30.708921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:30.709683 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:30.710123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:30.723144 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] HTTP exception thrown: Instance 063e140e-70f9-429a-80c2-89939549e287 could not be found. Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Request method failure captured: Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 HTTP/1.1 Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizDCFxcMnHT9kkklKHCveMYG4CrIWIxW5cUuuoMblN97cblW0LSO2hsJet6CXx1U686qq3Fl-84xSBke1Rggt5kY0We7yhx8hESopoA6T0S5-y5GSv7Taer11ZOWjY4stOw_N_Gqyroe-7IJiY7fXGHv_imwAR8OwPGLWc-62OBuhMzs Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:24:30.724772 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_67d8660c31bf48e9a2c6a5edb2060bde", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}] Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 3c85d19cf42f4688bbc89a439d96ca69 Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 063e140e-70f9-429a-80c2-89939549e287 could not be found. Jul 11 14:24:30.726617 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '063e140e-70f9-429a-80c2-89939549e287'} Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063e140e-70f9-429a-80c2-89939549e287 could not be found. Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:30.727653 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063e140e-70f9-429a-80c2-89939549e287 could not be found. Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063e140e-70f9-429a-80c2-89939549e287 could not be found. Jul 11 14:24:30.729478 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:30.731728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Returning 404 to user: Instance 063e140e-70f9-429a-80c2-89939549e287 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:30.731728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-c4137466-b9c5-47e7-8244-dc081e7cd6df tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jul 11 14:24:30.731728 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 592/1188] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:30 2022] GET /compute/v2.1/servers/063e140e-70f9-429a-80c2-89939549e287 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:34.033554 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:34.034094 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:34.034921 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-3f216fe0-ce5d-4f39-90bd-d7aa80d63111 req-f5908d60-d52f-4f17-ae16-b76e2c954791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f6a54aa-4081-430f-b08c-e9abf09978ea", "tag": "dd18d87b-e16c-4bc6-bf41-4bf41d35a33b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:34.040648 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:34.041099 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:34.041869 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:34.042316 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:34.044742 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-3f216fe0-ce5d-4f39-90bd-d7aa80d63111 req-f5908d60-d52f-4f17-ae16-b76e2c954791 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:34.045296 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-3f216fe0-ce5d-4f39-90bd-d7aa80d63111 req-f5908d60-d52f-4f17-ae16-b76e2c954791 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:34.057550 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-3f216fe0-ce5d-4f39-90bd-d7aa80d63111 req-f5908d60-d52f-4f17-ae16-b76e2c954791 service nova] Creating event network-changed:dd18d87b-e16c-4bc6-bf41-4bf41d35a33b for instance 1f6a54aa-4081-430f-b08c-e9abf09978ea on hv-cinder-84842 Jul 11 14:24:34.062847 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-3f216fe0-ce5d-4f39-90bd-d7aa80d63111 req-f5908d60-d52f-4f17-ae16-b76e2c954791 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Jul 11 14:24:34.063639 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 593/1189] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 11 14:24:34.072576 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Going to try to terminate instance {{(pid=117981) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 11 14:24:34.156770 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-5e33b695-4784-4009-89cd-fef02422ccb4 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 204 len: 0 microversion: 2.1 time: 0.126443 Jul 11 14:24:34.157196 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 597/1190] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:24:34 2022] DELETE /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 11 14:24:34.173215 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:34.174187 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:34.180777 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:34.181229 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:34.182014 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:34.182475 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:34.320008 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.policy [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117980) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:34.328444 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-f05246ef-6eae-48b6-a91b-8feb22ed2f87 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1574 microversion: 2.1 time: 0.163083 Jul 11 14:24:34.329162 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 594/1191] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:34 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:35.346663 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:35.347992 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:35.353989 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:35.354414 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:35.355183 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:35.355614 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:35.488601 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:35.498297 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-034c7ac8-b84e-4b65-b88f-94d0d772aa30 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1574 microversion: 2.1 time: 0.156242 Jul 11 14:24:35.499125 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 598/1192] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:35 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:36.327884 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [req-33879df8-9567-46e0-b5e3-171c4471f74e req-535f2776-139e-461d-aacf-8833233de1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f6a54aa-4081-430f-b08c-e9abf09978ea", "name": "network-vif-deleted", "tag": "dd18d87b-e16c-4bc6-bf41-4bf41d35a33b"}]} {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 11 14:24:36.336390 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-33879df8-9567-46e0-b5e3-171c4471f74e req-535f2776-139e-461d-aacf-8833233de1b7 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:36.336837 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [req-33879df8-9567-46e0-b5e3-171c4471f74e req-535f2776-139e-461d-aacf-8833233de1b7 service nova] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:36.349059 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.compute.server_external_events [req-33879df8-9567-46e0-b5e3-171c4471f74e req-535f2776-139e-461d-aacf-8833233de1b7 service nova] Creating event network-vif-deleted:dd18d87b-e16c-4bc6-bf41-4bf41d35a33b for instance 1f6a54aa-4081-430f-b08c-e9abf09978ea on hv-cinder-84842 Jul 11 14:24:36.354980 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [req-33879df8-9567-46e0-b5e3-171c4471f74e req-535f2776-139e-461d-aacf-8833233de1b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031675 Jul 11 14:24:36.355743 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 595/1193] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Jul 11 14:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 11 14:24:36.517024 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:36.517557 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:36.524062 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:36.524501 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:36.525306 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:36.525736 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:36.587364 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.policy [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c85d19cf42f4688bbc89a439d96ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8660c31bf48e9a2c6a5edb2060bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117981) authorize /opt/stack/nova/nova/policy.py:199}} Jul 11 14:24:36.598047 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-b240fe54-4b9d-404e-aa63-aae5f7345c16 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 200 len: 1224 microversion: 2.1 time: 0.085487 Jul 11 14:24:36.598664 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 599/1194] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:36 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 11 14:24:37.615910 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:37.616666 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 1f6a54aa-4081-430f-b08c-e9abf09978ea] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:37.624607 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:37.625056 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:37.625847 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:37.626366 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:37.640971 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] HTTP exception thrown: Instance 1f6a54aa-4081-430f-b08c-e9abf09978ea could not be found. Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Request method failure captured: Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea HTTP/1.1 Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizDCFxcMnHT9kkklKHCveMYG4CrIWIxW5cUuuoMblN97cblW0LSO2hsJet6CXx1U686qq3Fl-84xSBke1Rggt5kY0We7yhx8hESopoA6T0S5-y5GSv7Taer11ZOWjY4stOw_N_Gqyroe-7IJiY7fXGHv_imwAR8OwPGLWc-62OBuhMzs Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:24:37.642641 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_67d8660c31bf48e9a2c6a5edb2060bde", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}] Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 3c85d19cf42f4688bbc89a439d96ca69 Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 1f6a54aa-4081-430f-b08c-e9abf09978ea could not be found. Jul 11 14:24:37.644391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '1f6a54aa-4081-430f-b08c-e9abf09978ea'} Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f6a54aa-4081-430f-b08c-e9abf09978ea could not be found. Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:37.645288 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f6a54aa-4081-430f-b08c-e9abf09978ea could not be found. Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f6a54aa-4081-430f-b08c-e9abf09978ea could not be found. Jul 11 14:24:37.646669 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:37.647938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Returning 404 to user: Instance 1f6a54aa-4081-430f-b08c-e9abf09978ea could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:37.647938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-46c03830-c37b-4adb-9b15-41487812d581 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea" status: 404 len: 111 microversion: 2.1 time: 0.032396 Jul 11 14:24:37.647938 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 596/1195] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:37 2022] GET /compute/v2.1/servers/1f6a54aa-4081-430f-b08c-e9abf09978ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:38.109845 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:38.110439 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.compute.api [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117981) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:38.117059 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:38.117530 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:38.118296 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:38.118747 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG oslo_concurrency.lockutils [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:38.132101 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.wsgi [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] HTTP exception thrown: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Request method failure captured: Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: request: DELETE /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 HTTP/1.1 Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept: application/json Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Accept-Encoding: identity Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Connection: close Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Length: 0 Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Content-Type: application/json Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Host: 10.222.0.49 Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Openstack-System-Scope: None Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Auth-Token: gAAAAABizDCFxcMnHT9kkklKHCveMYG4CrIWIxW5cUuuoMblN97cblW0LSO2hsJet6CXx1U686qq3Fl-84xSBke1Rggt5kY0We7yhx8hESopoA6T0S5-y5GSv7Taer11ZOWjY4stOw_N_Gqyroe-7IJiY7fXGHv_imwAR8OwPGLWc-62OBuhMzs Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Id: None Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Domain-Name: None Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Identity-Status: Confirmed Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Is-Admin-Project: True Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Id: default Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Domain-Name: Default Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Project-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Role: reader,member Jul 11 14:24:38.133692 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Roles: reader,member Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_67d8660c31bf48e9a2c6a5edb2060bde", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}] Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-Tenant-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Id: default Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Domain-Name: Default Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Id: 3c85d19cf42f4688bbc89a439d96ca69 Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: X-User-Name: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: method: > Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: exception: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.135388 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: action_args: {'id': '2133fb7b-9f2f-4e3f-8d2c-73095a827fd4'} Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:38.136336 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.138173 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.139884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Returning 404 to user: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. {{(pid=117981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:38.139884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-19b10c45-d469-4eef-872d-f4838df39ba3 tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 404 len: 111 microversion: 2.1 time: 0.029271 Jul 11 14:24:38.139884 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 600/1196] 10.222.0.49 () {58 vars in 1238 bytes} [Mon Jul 11 14:24:38 2022] DELETE /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:38.144385 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '>' {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:38.144984 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.compute.api [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] [instance: 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4] Fetching instance by UUID {{(pid=117980) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 11 14:24:38.151123 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:38.151566 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:38.152323 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 11 14:24:38.153391 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG oslo_concurrency.lockutils [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Lock "b1758d6a-ad81-4545-a820-3e6926618f09" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 11 14:24:38.167283 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.wsgi [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] HTTP exception thrown: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Request method failure captured: Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: request: GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 HTTP/1.1 Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept: application/json Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Accept-Encoding: identity Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Connection: close Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Length: 0 Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Content-Type: application/json Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Host: 10.222.0.49 Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Openstack-System-Scope: None Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: User-Agent: python-urllib3/1.26.9 Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Auth-Token: gAAAAABizDCFxcMnHT9kkklKHCveMYG4CrIWIxW5cUuuoMblN97cblW0LSO2hsJet6CXx1U686qq3Fl-84xSBke1Rggt5kY0We7yhx8hESopoA6T0S5-y5GSv7Taer11ZOWjY4stOw_N_Gqyroe-7IJiY7fXGHv_imwAR8OwPGLWc-62OBuhMzs Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Id: None Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Domain-Name: None Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Identity-Status: Confirmed Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Is-Admin-Project: True Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Id: default Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Domain-Name: Default Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Project-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Role: reader,member Jul 11 14:24:38.168845 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Roles: reader,member Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_67d8660c31bf48e9a2c6a5edb2060bde", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/67d8660c31bf48e9a2c6a5edb2060bde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/67d8660c31bf48e9a2c6a5edb2060bde"}]}] Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Id: 67d8660c31bf48e9a2c6a5edb2060bde Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-Tenant-Name: tempest-TestVolumeBootPattern-952684956 Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Id: default Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Domain-Name: Default Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Id: 3c85d19cf42f4688bbc89a439d96ca69 Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: X-User-Name: tempest-TestVolumeBootPattern-952684956-project Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: method: > Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: exception: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.170646 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: action_args: {'id': '2133fb7b-9f2f-4e3f-8d2c-73095a827fd4'} Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: {{(pid=117980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 11 14:24:38.171920 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. Jul 11 14:24:38.173555 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: ERROR nova.api.openstack.wsgi Jul 11 14:24:38.175260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: DEBUG nova.api.openstack.wsgi [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Returning 404 to user: Instance 2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 could not be found. {{(pid=117980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 11 14:24:38.175260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO nova.api.openstack.requestlog [None req-cf55fbdb-e458-4cde-b6c9-7393f3e9a84e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4" status: 404 len: 111 microversion: 2.1 time: 0.029681 Jul 11 14:24:38.175260 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: [pid: 117980|app: 0|req: 597/1197] 10.222.0.49 () {58 vars in 1235 bytes} [Mon Jul 11 14:24:38 2022] GET /compute/v2.1/servers/2133fb7b-9f2f-4e3f-8d2c-73095a827fd4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 11 14:24:39.464714 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: DEBUG nova.api.openstack.wsgi [None req-3da7d55e-3457-4c15-bdbe-358316efde4e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] Calling method '.version_select at 0x7ffad52e40d0>' {{(pid=117981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 11 14:24:39.487949 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO nova.api.openstack.requestlog [None req-3da7d55e-3457-4c15-bdbe-358316efde4e tempest-TestVolumeBootPattern-952684956 tempest-TestVolumeBootPattern-952684956-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-109109376" status: 202 len: 0 microversion: 2.1 time: 0.028163 Jul 11 14:24:39.488457 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: [pid: 117981|app: 0|req: 601/1198] 10.222.0.49 () {58 vars in 1259 bytes} [Mon Jul 11 14:24:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-109109376 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 11 14:25:25.390833 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:25:25.391460 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:25:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:25:36.137312 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:25:36.137892 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:25:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:27:02.560407 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:27:02.561244 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:27:06.410735 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:27:06.411317 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:27:28.377039 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:27:28.377616 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:27:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:27:29.193289 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:27:29.193858 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:28:45.399355 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:28:45.400219 dv-cinder-848429-3-iscsi devstack@n-api.service[117980]: Mon Jul 11 14:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:28:56.145629 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:28:56.146276 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:28:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 11 14:30:22.569022 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 11 14:30:22.569931 dv-cinder-848429-3-iscsi devstack@n-api.service[117981]: Mon Jul 11 14:30:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!